Apr 11 19:17:22 user nova-compute[82196]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 11 19:17:25 user nova-compute[82196]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=82196) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=82196) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=82196) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 19:17:25 user nova-compute[82196]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:17:25 user nova-compute[82196]: INFO nova.virt.driver [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 11 19:17:25 user nova-compute[82196]: INFO nova.compute.provider_config [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] Acquiring lock "singleton_lock" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] Acquired lock "singleton_lock" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] Releasing lock "singleton_lock" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] Full set of CONF: {{(pid=82196) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ******************************************************************************** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] Configuration options gathered from: {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ================================================================================ {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] allow_resize_to_same_host      = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] arq_binding_timeout            = 300 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] backdoor_port                  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] backdoor_socket                = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] block_device_allocate_retries  = 300 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] block_device_allocate_retries_interval = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cert                           = self.pem {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute_monitors               = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] config_dir                     = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] config_drive_format            = iso9660 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] config_source                  = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] console_host                   = user {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] control_exchange               = nova {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cpu_allocation_ratio           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] daemon                         = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] debug                          = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] default_access_ip_network_name = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] default_availability_zone      = nova {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] default_ephemeral_format       = ext4 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] default_schedule_zone          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] disk_allocation_ratio          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] enable_new_services            = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] enabled_apis                   = ['osapi_compute'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] enabled_ssl_apis               = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] flat_injected                  = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] force_config_drive             = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] force_raw_images               = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] graceful_shutdown_timeout      = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] heal_instance_info_cache_interval = 60 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] host                           = user {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] initial_disk_allocation_ratio  = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] initial_ram_allocation_ratio   = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] instance_build_timeout         = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] instance_delete_interval       = 300 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] instance_format                = [instance: %(uuid)s]  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] instance_name_template         = instance-%08x {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] instance_usage_audit           = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] instance_usage_audit_period    = month {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] internal_service_availability_zone = internal {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] key                            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] live_migration_retry_count     = 30 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] log_config_append              = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] log_dir                        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] log_file                       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] log_options                    = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] log_rotate_interval            = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] log_rotate_interval_type       = days {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] log_rotation_type              = none {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] long_rpc_timeout               = 1800 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] max_concurrent_builds          = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] max_concurrent_live_migrations = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] max_concurrent_snapshots       = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] max_local_block_devices        = 3 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] max_logfile_count              = 30 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] max_logfile_size_mb            = 200 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] maximum_instance_delete_attempts = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] metadata_listen                = 0.0.0.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] metadata_listen_port           = 8775 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] metadata_workers               = 3 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] migrate_max_retries            = -1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] mkisofs_cmd                    = genisoimage {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] my_block_storage_ip            = 10.0.0.210 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] my_ip                          = 10.0.0.210 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] network_allocate_retries       = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] osapi_compute_listen           = 0.0.0.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] osapi_compute_listen_port      = 8774 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] osapi_compute_unique_server_name_scope =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] osapi_compute_workers          = 3 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] password_length                = 12 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] periodic_enable                = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] periodic_fuzzy_delay           = 60 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] pointer_model                  = ps2mouse {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] preallocate_images             = none {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] publish_errors                 = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] pybasedir                      = /opt/stack/nova {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ram_allocation_ratio           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] rate_limit_burst               = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] rate_limit_except_level        = CRITICAL {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] rate_limit_interval            = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] reboot_timeout                 = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] reclaim_instance_interval      = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] record                         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] reimage_timeout_per_gb         = 20 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] report_interval                = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] rescue_timeout                 = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] reserved_host_cpus             = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] reserved_host_disk_mb          = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] reserved_host_memory_mb        = 512 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] reserved_huge_pages            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] resize_confirm_window          = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] resize_fs_using_block_device   = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] resume_guests_state_on_host_boot = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] rpc_response_timeout           = 60 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] run_external_periodic_tasks    = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] running_deleted_instance_action = reap {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] running_deleted_instance_poll_interval = 1800 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] running_deleted_instance_timeout = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] scheduler_instance_sync_interval = 120 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] service_down_time              = 60 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] servicegroup_driver            = db {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] shelved_offload_time           = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] shelved_poll_interval          = 3600 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] shutdown_timeout               = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] source_is_ipv6                 = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ssl_only                       = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] state_path                     = /opt/stack/data/nova {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] sync_power_state_interval      = 600 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] sync_power_state_pool_size     = 1000 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] syslog_log_facility            = LOG_USER {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] tempdir                        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] timeout_nbd                    = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] transport_url                  = **** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] update_resources_interval      = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] use_cow_images                 = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] use_eventlog                   = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] use_journal                    = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] use_json                       = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] use_rootwrap_daemon            = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] use_stderr                     = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] use_syslog                     = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vcpu_pin_set                   = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plugging_is_fatal          = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plugging_timeout           = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] virt_mkfs                      = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] volume_usage_poll_interval     = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] watch_log_file                 = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] web                            = /usr/share/spice-html5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_concurrency.disable_process_locking = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.auth_strategy              = keystone {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.compute_link_prefix        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.dhcp_domain                = novalocal {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.enable_instance_password   = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.glance_link_prefix         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.instance_list_cells_batch_strategy = distributed {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.instance_list_per_project_cells = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.list_records_by_skipping_down_cells = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.local_metadata_per_cell    = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.max_limit                  = 1000 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.metadata_cache_expiration  = 15 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.neutron_default_tenant_id  = default {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.use_forwarded_for          = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.use_neutron_default_nets   = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.vendordata_dynamic_failure_fatal = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.vendordata_dynamic_targets = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.vendordata_jsonfile_path   = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.backend                  = dogpile.cache.memcached {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.backend_argument         = **** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.config_prefix            = cache.oslo {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.dead_timeout             = 60.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.debug_cache_backend      = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.enable_retry_client      = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.enable_socket_keepalive  = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.enabled                  = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.expiration_time          = 600 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.hashclient_retry_attempts = 2 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.memcache_dead_retry      = 300 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.memcache_password        =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.memcache_pool_maxsize    = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.memcache_sasl_enabled    = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.memcache_username        =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.proxies                  = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.retry_attempts           = 2 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.retry_delay              = 0.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.socket_keepalive_count   = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.socket_keepalive_idle    = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.socket_keepalive_interval = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.tls_allowed_ciphers      = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.tls_cafile               = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.tls_certfile             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.tls_enabled              = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cache.tls_keyfile              = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.auth_section            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.auth_type               = password {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.cafile                  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.catalog_info            = volumev3::publicURL {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.certfile                = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.collect_timing          = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.cross_az_attach         = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.debug                   = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.endpoint_template       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.http_retries            = 3 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.insecure                = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.keyfile                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.os_region_name          = RegionOne {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.split_loggers           = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cinder.timeout                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute.cpu_dedicated_set      = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute.cpu_shared_set         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute.image_type_exclude_list = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute.live_migration_wait_for_vif_plug = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute.max_concurrent_disk_ops = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute.max_disk_devices_to_attach = -1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute.resource_provider_association_refresh = 300 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute.shutdown_retry_interval = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] conductor.workers              = 3 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] console.allowed_origins        = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] console.ssl_ciphers            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] console.ssl_minimum_version    = default {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] consoleauth.token_ttl          = 600 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.cafile                  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.certfile                = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.collect_timing          = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.connect_retries         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.connect_retry_delay     = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.endpoint_override       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.insecure                = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.keyfile                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.max_version             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.min_version             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.region_name             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.service_name            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.service_type            = accelerator {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.split_loggers           = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.status_code_retries     = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.status_code_retry_delay = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.timeout                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] cyborg.version                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.backend               = sqlalchemy {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.connection            = **** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.connection_debug      = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.connection_parameters =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.connection_recycle_time = 3600 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.connection_trace      = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.db_inc_retry_interval = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.db_max_retries        = 20 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.db_max_retry_interval = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.db_retry_interval     = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.max_overflow          = 50 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.max_pool_size         = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.max_retries           = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.mysql_enable_ndb      = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.mysql_wsrep_sync_wait = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.pool_timeout          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.retry_interval        = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.slave_connection      = **** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] database.sqlite_synchronous    = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.backend           = sqlalchemy {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.connection        = **** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.connection_debug  = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.connection_parameters =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.connection_recycle_time = 3600 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.connection_trace  = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.db_inc_retry_interval = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.db_max_retries    = 20 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.db_max_retry_interval = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.db_retry_interval = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.max_overflow      = 50 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.max_pool_size     = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.max_retries       = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.mysql_enable_ndb  = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.mysql_wsrep_sync_wait = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.pool_timeout      = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.retry_interval    = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.slave_connection  = **** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] api_database.sqlite_synchronous = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] devices.enabled_mdev_types     = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ephemeral_storage_encryption.enabled = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ephemeral_storage_encryption.key_size = 512 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.api_servers             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.cafile                  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.certfile                = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.collect_timing          = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.connect_retries         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.connect_retry_delay     = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.debug                   = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.default_trusted_certificate_ids = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.enable_certificate_validation = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.enable_rbd_download     = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.endpoint_override       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.insecure                = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.keyfile                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.max_version             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.min_version             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.num_retries             = 3 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.rbd_ceph_conf           =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.rbd_connect_timeout     = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.rbd_pool                =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.rbd_user                =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.region_name             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.service_name            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.service_type            = image {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.split_loggers           = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.status_code_retries     = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.status_code_retry_delay = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.timeout                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.verify_glance_signatures = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] glance.version                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] guestfs.debug                  = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.config_drive_cdrom      = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.config_drive_inject_password = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.enable_instance_metrics_collection = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.enable_remotefx         = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.instances_path_share    =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.iscsi_initiator_list    = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.limit_cpu_features      = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.power_state_check_timeframe = 60 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.power_state_event_polling_interval = 2 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.use_multipath_io        = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.volume_attach_retry_count = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.volume_attach_retry_interval = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.vswitch_name            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] mks.enabled                    = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] image_cache.manager_interval   = 2400 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] image_cache.precache_concurrency = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] image_cache.remove_unused_base_images = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] image_cache.subdirectory_name  = _base {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.api_max_retries         = 60 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.api_retry_interval      = 2 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.auth_section            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.auth_type               = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.cafile                  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.certfile                = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.collect_timing          = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.connect_retries         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.connect_retry_delay     = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.endpoint_override       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.insecure                = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.keyfile                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.max_version             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.min_version             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.partition_key           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.peer_list               = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.region_name             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.serial_console_state_timeout = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.service_name            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.service_type            = baremetal {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.split_loggers           = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.status_code_retries     = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.status_code_retry_delay = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.timeout                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ironic.version                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] key_manager.fixed_key          = **** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.barbican_api_version  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.barbican_endpoint     = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.barbican_endpoint_type = public {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.barbican_region_name  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.cafile                = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.certfile              = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.collect_timing        = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.insecure              = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.keyfile               = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.number_of_retries     = 60 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.retry_delay           = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.send_service_user_token = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.split_loggers         = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.timeout               = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.verify_ssl            = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican.verify_ssl_path       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican_service_user.auth_section = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican_service_user.auth_type = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican_service_user.cafile   = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican_service_user.certfile = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican_service_user.collect_timing = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican_service_user.insecure = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican_service_user.keyfile  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican_service_user.split_loggers = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] barbican_service_user.timeout  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.approle_role_id          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.approle_secret_id        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.cafile                   = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.certfile                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.collect_timing           = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.insecure                 = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.keyfile                  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.kv_mountpoint            = secret {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.kv_version               = 2 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.namespace                = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.root_token_id            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.split_loggers            = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.ssl_ca_crt_file          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.timeout                  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.use_ssl                  = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.cafile                = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.certfile              = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.collect_timing        = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.connect_retries       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.connect_retry_delay   = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.endpoint_override     = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.insecure              = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.keyfile               = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.max_version           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.min_version           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.region_name           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.service_name          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.service_type          = identity {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.split_loggers         = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.status_code_retries   = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.status_code_retry_delay = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.timeout               = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] keystone.version               = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.connection_uri         =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.cpu_mode               = custom {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.cpu_model_extra_flags  = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: WARNING oslo_config.cfg [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.cpu_power_governor_high = performance {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.cpu_power_governor_low = powersave {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.cpu_power_management   = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.device_detach_attempts = 8 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.device_detach_timeout  = 20 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.disk_cachemodes        = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.disk_prefix            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.enabled_perf_events    = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.file_backed_memory     = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.gid_maps               = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.hw_disk_discard        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.hw_machine_type        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.images_rbd_ceph_conf   =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.images_rbd_glance_store_name =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.images_rbd_pool        = rbd {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.images_type            = default {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.images_volume_group    = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.inject_key             = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.inject_partition       = -2 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.inject_password        = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.iscsi_iface            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.iser_use_multipath     = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_bandwidth = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_completion_timeout = 800 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_downtime = 500 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_downtime_delay = 75 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_downtime_steps = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_inbound_addr = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_permit_auto_converge = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_permit_post_copy = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_scheme  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_timeout_action = abort {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_tunnelled = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: WARNING oslo_config.cfg [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 11 19:17:25 user nova-compute[82196]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 11 19:17:25 user nova-compute[82196]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 11 19:17:25 user nova-compute[82196]: and ``live_migration_inbound_addr`` respectively.
Apr 11 19:17:25 user nova-compute[82196]: ).  Its value may be silently ignored in the future.
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.live_migration_with_native_tls = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.max_queues             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.mem_stats_period_seconds = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.nfs_mount_options      = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.num_aoe_discover_tries = 3 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.num_iser_scan_tries    = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.num_memory_encrypted_guests = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.num_nvme_discover_tries = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.num_pcie_ports         = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.num_volume_scan_tries  = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.pmem_namespaces        = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.quobyte_client_cfg     = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.rbd_connect_timeout    = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.rbd_secret_uuid        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.rbd_user               = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.realtime_scheduler_priority = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.remote_filesystem_transport = ssh {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.rescue_image_id        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.rescue_kernel_id       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.rescue_ramdisk_id      = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.rx_queue_size          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.smbfs_mount_options    =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.snapshot_compression   = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.snapshot_image_format  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.sparse_logical_volumes = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.swtpm_enabled          = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.swtpm_group            = tss {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.swtpm_user             = tss {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.sysinfo_serial         = unique {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.tx_queue_size          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.uid_maps               = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.use_virtio_for_bridges = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.virt_type              = kvm {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.volume_clear           = zero {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.volume_clear_size      = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.volume_use_multipath   = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.vzstorage_cache_path   = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.vzstorage_mount_group  = qemu {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.vzstorage_mount_opts   = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.vzstorage_mount_user   = stack {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.auth_section           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.auth_type              = password {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.cafile                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.certfile               = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.collect_timing         = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.connect_retries        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.connect_retry_delay    = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.default_floating_pool  = public {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.endpoint_override      = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.extension_sync_interval = 600 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.http_retries           = 3 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.insecure               = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.keyfile                = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.max_version            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.metadata_proxy_shared_secret = **** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.min_version            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.ovs_bridge             = br-int {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.physnets               = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.region_name            = RegionOne {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.service_metadata_proxy = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.service_name           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.service_type           = network {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.split_loggers          = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.status_code_retries    = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.status_code_retry_delay = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.timeout                = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] neutron.version                = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] notifications.bdms_in_notifications = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] notifications.default_level    = INFO {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] notifications.notification_format = unversioned {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] notifications.notify_on_state_change = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] pci.alias                      = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] pci.device_spec                = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] pci.report_in_placement        = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.auth_section         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.auth_type            = password {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.cafile               = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.certfile             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.collect_timing       = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.connect_retries      = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.connect_retry_delay  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.default_domain_id    = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.default_domain_name  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.domain_id            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.domain_name          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.endpoint_override    = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.insecure             = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.keyfile              = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.max_version          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.min_version          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.password             = **** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.project_domain_id    = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.project_domain_name  = Default {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.project_id           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.project_name         = service {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.region_name          = RegionOne {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.service_name         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.service_type         = placement {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.split_loggers        = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.status_code_retries  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.status_code_retry_delay = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.system_scope         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.timeout              = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.trust_id             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.user_domain_id       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.user_domain_name     = Default {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.user_id              = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.username             = placement {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] placement.version              = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.cores                    = 20 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.count_usage_from_placement = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.injected_file_content_bytes = 10240 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.injected_file_path_length = 255 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.injected_files           = 5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.instances                = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.key_pairs                = 100 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.metadata_items           = 128 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.ram                      = 51200 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.recheck_quota            = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.server_group_members     = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] quota.server_groups            = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] rdp.enabled                    = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] scheduler.image_metadata_prefilter = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] scheduler.max_attempts         = 3 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] scheduler.max_placement_results = 1000 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] scheduler.query_placement_for_availability_zone = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] scheduler.query_placement_for_image_type_support = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] scheduler.workers              = 3 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.host_subset_size = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.image_properties_default_architecture = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.isolated_hosts = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.isolated_images = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.max_instances_per_host = 50 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.pci_in_placement = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.track_instance_changes = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] metrics.required               = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] metrics.weight_multiplier      = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] metrics.weight_setting         = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] serial_console.enabled         = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] serial_console.port_range      = 10000:20000 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] serial_console.serialproxy_port = 6083 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] service_user.auth_section      = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] service_user.auth_type         = password {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] service_user.cafile            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] service_user.certfile          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] service_user.collect_timing    = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] service_user.insecure          = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] service_user.keyfile           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] service_user.send_service_user_token = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] service_user.split_loggers     = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] service_user.timeout           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] spice.agent_enabled            = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] spice.enabled                  = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] spice.html5proxy_port          = 6082 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] spice.image_compression        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] spice.jpeg_compression         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] spice.playback_compression     = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] spice.server_listen            = 127.0.0.1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] spice.streaming_mode           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] spice.zlib_compression         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] upgrade_levels.baseapi         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] upgrade_levels.cert            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] upgrade_levels.compute         = auto {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] upgrade_levels.conductor       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] upgrade_levels.scheduler       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vendordata_dynamic_auth.auth_section = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vendordata_dynamic_auth.auth_type = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vendordata_dynamic_auth.cafile = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vendordata_dynamic_auth.certfile = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vendordata_dynamic_auth.collect_timing = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vendordata_dynamic_auth.insecure = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vendordata_dynamic_auth.keyfile = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vendordata_dynamic_auth.split_loggers = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vendordata_dynamic_auth.timeout = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.api_retry_count         = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.ca_file                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.cache_prefix            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.cluster_name            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.connection_pool_size    = 10 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.console_delay_seconds   = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.datastore_regex         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.host_ip                 = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.host_password           = **** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.host_port               = 443 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.host_username           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.insecure                = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.integration_bridge      = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.maximum_objects         = 100 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.pbm_default_policy      = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.pbm_enabled             = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.pbm_wsdl_location       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.serial_port_proxy_uri   = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.serial_port_service_uri = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.task_poll_interval      = 0.5 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.use_linked_clone        = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.vnc_keymap              = en-us {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.vnc_port                = 5900 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vmware.vnc_port_total          = 10000 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vnc.auth_schemes               = ['none'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vnc.enabled                    = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vnc.novncproxy_port            = 6080 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vnc.server_listen              = 0.0.0.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vnc.vencrypt_ca_certs          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vnc.vencrypt_client_cert       = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vnc.vencrypt_client_key        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.disable_fallback_pcpu_query = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.disable_group_policy_check_upcall = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.disable_rootwrap   = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.enable_numa_live_migration = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.handle_virt_lifecycle_events = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.libvirt_disable_apic = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.never_download_image_if_on_rbd = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] wsgi.client_socket_timeout     = 900 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] wsgi.default_pool_size         = 1000 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] wsgi.keep_alive                = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] wsgi.max_header_line           = 16384 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] wsgi.secure_proxy_ssl_header   = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] wsgi.ssl_ca_file               = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] wsgi.ssl_cert_file             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] wsgi.ssl_key_file              = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] wsgi.tcp_keepidle              = 600 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] zvm.ca_file                    = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] zvm.cloud_connector_url        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] zvm.reachable_timeout          = 300 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_policy.enforce_new_defaults = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_policy.enforce_scope      = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_policy.policy_default_rule = default {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_policy.policy_file        = policy.yaml {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] profiler.connection_string     = messaging:// {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] profiler.enabled               = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] profiler.es_doc_type           = notification {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] profiler.es_scroll_size        = 10000 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] profiler.es_scroll_time        = 2m {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] profiler.filter_error_trace    = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] profiler.hmac_keys             = SECRET_KEY {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] profiler.sentinel_service_name = mymaster {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] profiler.socket_timeout        = 0.1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] profiler.trace_sqlalchemy      = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] remote_debug.host              = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] remote_debug.port              = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.ssl      = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_notifications.retry = -1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_messaging_notifications.transport_url = **** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.auth_section        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.auth_type           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.cafile              = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.certfile            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.collect_timing      = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.connect_retries     = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.connect_retry_delay = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.endpoint_id         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.endpoint_override   = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.insecure            = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.keyfile             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.max_version         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.min_version         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.region_name         = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.service_name        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.service_type        = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.split_loggers       = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.status_code_retries = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.status_code_retry_delay = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.timeout             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.valid_interfaces    = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_limit.version             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_reports.file_event_handler = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] oslo_reports.log_dir           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plug_linux_bridge_privileged.group = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plug_linux_bridge_privileged.user = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plug_ovs_privileged.group  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plug_ovs_privileged.helper_command = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] vif_plug_ovs_privileged.user   = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_linux_bridge.flat_interface = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_linux_bridge.vlan_interface = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_ovs.isolate_vif         = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_ovs.ovsdb_interface     = native {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_vif_ovs.per_port_bridge     = False {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] os_brick.lock_path             = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] privsep_osbrick.capabilities   = [21] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] privsep_osbrick.group          = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] privsep_osbrick.helper_command = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] privsep_osbrick.thread_pool_size = 12 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] privsep_osbrick.user           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] nova_sys_admin.group           = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] nova_sys_admin.helper_command  = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] nova_sys_admin.thread_pool_size = 12 {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] nova_sys_admin.user            = None {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 19:17:25 user nova-compute[82196]: DEBUG oslo_service.service [None req-5859a514-0fa1-4f68-834c-17b75673ea9d None None] ******************************************************************************** {{(pid=82196) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 11 19:17:25 user nova-compute[82196]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 11 19:17:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Starting native event thread {{(pid=82196) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 11 19:17:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Starting green dispatch thread {{(pid=82196) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 11 19:17:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Starting connection event dispatch thread {{(pid=82196) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 11 19:17:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Connecting to libvirt: qemu:///system {{(pid=82196) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 11 19:17:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f927d9ba5f0> {{(pid=82196) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 11 19:17:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f927d9ba5f0> {{(pid=82196) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 11 19:17:26 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Connection event '1' reason 'None'
Apr 11 19:17:26 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 19:17:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.mount [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Initialising _HostMountState generation 0 {{(pid=82196) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 11 19:17:33 user nova-compute[82196]: INFO nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Libvirt host capabilities <capabilities>
Apr 11 19:17:33 user nova-compute[82196]:   <host>
Apr 11 19:17:33 user nova-compute[82196]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 11 19:17:33 user nova-compute[82196]:     <cpu>
Apr 11 19:17:33 user nova-compute[82196]:       <arch>x86_64</arch>
Apr 11 19:17:33 user nova-compute[82196]:       <model>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <vendor>Intel</vendor>
Apr 11 19:17:33 user nova-compute[82196]:       <microcode version='1070'/>
Apr 11 19:17:33 user nova-compute[82196]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 11 19:17:33 user nova-compute[82196]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='ss'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='vmx'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='pcid'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='osxsave'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='hypervisor'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='arat'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='tsc_adjust'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='md-clear'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='arch-capabilities'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='invtsc'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='rsba'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature name='skip-l1dfl-vmentry'/>
Apr 11 19:17:33 user nova-compute[82196]:       <pages unit='KiB' size='4'/>
Apr 11 19:17:33 user nova-compute[82196]:       <pages unit='KiB' size='2048'/>
Apr 11 19:17:33 user nova-compute[82196]:     </cpu>
Apr 11 19:17:33 user nova-compute[82196]:     <power_management>
Apr 11 19:17:33 user nova-compute[82196]:       <suspend_mem/>
Apr 11 19:17:33 user nova-compute[82196]:       <suspend_disk/>
Apr 11 19:17:33 user nova-compute[82196]:       <suspend_hybrid/>
Apr 11 19:17:33 user nova-compute[82196]:     </power_management>
Apr 11 19:17:33 user nova-compute[82196]:     <iommu support='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     <migration_features>
Apr 11 19:17:33 user nova-compute[82196]:       <live/>
Apr 11 19:17:33 user nova-compute[82196]:       <uri_transports>
Apr 11 19:17:33 user nova-compute[82196]:         <uri_transport>tcp</uri_transport>
Apr 11 19:17:33 user nova-compute[82196]:         <uri_transport>rdma</uri_transport>
Apr 11 19:17:33 user nova-compute[82196]:       </uri_transports>
Apr 11 19:17:33 user nova-compute[82196]:     </migration_features>
Apr 11 19:17:33 user nova-compute[82196]:     <topology>
Apr 11 19:17:33 user nova-compute[82196]:       <cells num='2'>
Apr 11 19:17:33 user nova-compute[82196]:         <cell id='0'>
Apr 11 19:17:33 user nova-compute[82196]:           <memory unit='KiB'>8152920</memory>
Apr 11 19:17:33 user nova-compute[82196]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 11 19:17:33 user nova-compute[82196]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 19:17:33 user nova-compute[82196]:           <distances>
Apr 11 19:17:33 user nova-compute[82196]:             <sibling id='0' value='10'/>
Apr 11 19:17:33 user nova-compute[82196]:             <sibling id='1' value='20'/>
Apr 11 19:17:33 user nova-compute[82196]:           </distances>
Apr 11 19:17:33 user nova-compute[82196]:           <cpus num='6'>
Apr 11 19:17:33 user nova-compute[82196]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 11 19:17:33 user nova-compute[82196]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 11 19:17:33 user nova-compute[82196]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 11 19:17:33 user nova-compute[82196]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 11 19:17:33 user nova-compute[82196]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 11 19:17:33 user nova-compute[82196]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 11 19:17:33 user nova-compute[82196]:           </cpus>
Apr 11 19:17:33 user nova-compute[82196]:         </cell>
Apr 11 19:17:33 user nova-compute[82196]:         <cell id='1'>
Apr 11 19:17:33 user nova-compute[82196]:           <memory unit='KiB'>8255068</memory>
Apr 11 19:17:33 user nova-compute[82196]:           <pages unit='KiB' size='4'>2063767</pages>
Apr 11 19:17:33 user nova-compute[82196]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 19:17:33 user nova-compute[82196]:           <distances>
Apr 11 19:17:33 user nova-compute[82196]:             <sibling id='0' value='20'/>
Apr 11 19:17:33 user nova-compute[82196]:             <sibling id='1' value='10'/>
Apr 11 19:17:33 user nova-compute[82196]:           </distances>
Apr 11 19:17:33 user nova-compute[82196]:           <cpus num='6'>
Apr 11 19:17:33 user nova-compute[82196]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 11 19:17:33 user nova-compute[82196]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 11 19:17:33 user nova-compute[82196]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 11 19:17:33 user nova-compute[82196]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 11 19:17:33 user nova-compute[82196]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 11 19:17:33 user nova-compute[82196]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 11 19:17:33 user nova-compute[82196]:           </cpus>
Apr 11 19:17:33 user nova-compute[82196]:         </cell>
Apr 11 19:17:33 user nova-compute[82196]:       </cells>
Apr 11 19:17:33 user nova-compute[82196]:     </topology>
Apr 11 19:17:33 user nova-compute[82196]:     <cache>
Apr 11 19:17:33 user nova-compute[82196]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 11 19:17:33 user nova-compute[82196]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 11 19:17:33 user nova-compute[82196]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 11 19:17:33 user nova-compute[82196]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 11 19:17:33 user nova-compute[82196]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 11 19:17:33 user nova-compute[82196]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 11 19:17:33 user nova-compute[82196]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 11 19:17:33 user nova-compute[82196]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 11 19:17:33 user nova-compute[82196]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 11 19:17:33 user nova-compute[82196]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 11 19:17:33 user nova-compute[82196]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 11 19:17:33 user nova-compute[82196]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 11 19:17:33 user nova-compute[82196]:     </cache>
Apr 11 19:17:33 user nova-compute[82196]:     <secmodel>
Apr 11 19:17:33 user nova-compute[82196]:       <model>apparmor</model>
Apr 11 19:17:33 user nova-compute[82196]:       <doi>0</doi>
Apr 11 19:17:33 user nova-compute[82196]:     </secmodel>
Apr 11 19:17:33 user nova-compute[82196]:     <secmodel>
Apr 11 19:17:33 user nova-compute[82196]:       <model>dac</model>
Apr 11 19:17:33 user nova-compute[82196]:       <doi>0</doi>
Apr 11 19:17:33 user nova-compute[82196]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 11 19:17:33 user nova-compute[82196]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 11 19:17:33 user nova-compute[82196]:     </secmodel>
Apr 11 19:17:33 user nova-compute[82196]:   </host>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='alpha'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>64</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>clipper</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='armv6l'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>spitz</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>nuri</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>kzm</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sx1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>z2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>tosa</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>n810</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>n800</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>terrier</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>midway</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>microbit</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>verdex</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>highbank</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>akita</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>connex</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>collie</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='armv7l'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>spitz</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>nuri</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>kzm</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sx1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>z2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>tosa</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>n810</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>n800</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>terrier</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>midway</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>microbit</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>verdex</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>highbank</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>akita</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>connex</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>collie</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='aarch64'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>64</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>spitz</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>nuri</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>kzm</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sx1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>z2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>tosa</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>n810</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>n800</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>terrier</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>midway</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>microbit</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>verdex</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>raspi3b</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>highbank</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>akita</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>connex</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>collie</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <acpi default='on' toggle='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='cris'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='i686'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>isapc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>microvm</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='kvm'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <pae/>
Apr 11 19:17:33 user nova-compute[82196]:       <nonpae/>
Apr 11 19:17:33 user nova-compute[82196]:       <acpi default='on' toggle='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:       <apic default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='m68k'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>an5206</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>q800</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>next-cube</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='microblaze'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='microblazeel'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='mips'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='16'>malta</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='mipsel'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='16'>malta</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='mips64'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>64</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='16'>malta</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>pica61</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>magnum</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='mips64el'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>64</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='16'>malta</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>pica61</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>magnum</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='16'>boston</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='ppc'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mac99</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>40p</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>taihu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='ppc64'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>64</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>taihu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>40p</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mac99</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='ppc64le'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>64</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>taihu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>40p</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>mac99</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='riscv32'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='8'>spike</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>opentitan</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='8'>virt</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='riscv64'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>64</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='8'>spike</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>shakti_c</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='8'>virt</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='s390x'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>64</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='sh4'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>shix</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>r2d</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='sh4eb'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>64</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>shix</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>r2d</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='sparc'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>SS-5</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>SS-20</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>LX</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>SS-4</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>SS-10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>Voyager</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='sparc64'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>64</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sun4u</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>niagara</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>sun4v</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='x86_64'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>64</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='1'>isapc</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>microvm</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='kvm'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <acpi default='on' toggle='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:       <apic default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='xtensa'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>sim</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>kc705</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>ml605</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>virt</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>lx200</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>lx60</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]:   <guest>
Apr 11 19:17:33 user nova-compute[82196]:     <os_type>hvm</os_type>
Apr 11 19:17:33 user nova-compute[82196]:     <arch name='xtensaeb'>
Apr 11 19:17:33 user nova-compute[82196]:       <wordsize>32</wordsize>
Apr 11 19:17:33 user nova-compute[82196]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='4'>sim</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>kc705</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>ml605</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>virt</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>lx200</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>lx60</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 19:17:33 user nova-compute[82196]:       <domain type='qemu'/>
Apr 11 19:17:33 user nova-compute[82196]:     </arch>
Apr 11 19:17:33 user nova-compute[82196]:     <features>
Apr 11 19:17:33 user nova-compute[82196]:       <cpuselection/>
Apr 11 19:17:33 user nova-compute[82196]:       <deviceboot/>
Apr 11 19:17:33 user nova-compute[82196]:       <disksnapshot default='on' toggle='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     </features>
Apr 11 19:17:33 user nova-compute[82196]:   </guest>
Apr 11 19:17:33 user nova-compute[82196]: </capabilities>
Apr 11 19:17:33 user nova-compute[82196]: 
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for cris via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 11 19:17:33 user nova-compute[82196]: <domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 19:17:33 user nova-compute[82196]:   <domain>kvm</domain>
Apr 11 19:17:33 user nova-compute[82196]:   <machine>pc-i440fx-jammy</machine>
Apr 11 19:17:33 user nova-compute[82196]:   <arch>i686</arch>
Apr 11 19:17:33 user nova-compute[82196]:   <vcpu max='255'/>
Apr 11 19:17:33 user nova-compute[82196]:   <iothreads supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:   <os supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='firmware'/>
Apr 11 19:17:33 user nova-compute[82196]:     <loader supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>rom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pflash</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='readonly'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>yes</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='secure'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </loader>
Apr 11 19:17:33 user nova-compute[82196]:   </os>
Apr 11 19:17:33 user nova-compute[82196]:   <cpu>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-passthrough' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='hostPassthroughMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='maximum' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='maximumMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>on</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-model' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <vendor>Intel</vendor>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ss'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='vmx'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='pcid'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='hypervisor'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arat'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='umip'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='md-clear'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibpb'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibrs'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='erms'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='lm'/>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='custom' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>qemu64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>qemu32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>phenom</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>n270</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>kvm64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>kvm32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>coreduo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>core2duo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>athlon</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Westmere</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Snowridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Penryn</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G5</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G4</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G1</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Nehalem</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Rome</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Milan</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Dhyana</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cooperlake</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Conroe</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>486</model>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:   </cpu>
Apr 11 19:17:33 user nova-compute[82196]:   <memoryBacking supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='sourceType'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>file</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>anonymous</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>memfd</value>
Apr 11 19:17:33 user nova-compute[82196]:     </enum>
Apr 11 19:17:33 user nova-compute[82196]:   </memoryBacking>
Apr 11 19:17:33 user nova-compute[82196]:   <devices>
Apr 11 19:17:33 user nova-compute[82196]:     <disk supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='diskDevice'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>disk</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cdrom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>floppy</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>lun</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='bus'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>ide</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>fdc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sata</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </disk>
Apr 11 19:17:33 user nova-compute[82196]:     <graphics supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sdl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vnc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>spice</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egl-headless</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </graphics>
Apr 11 19:17:33 user nova-compute[82196]:     <video supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='modelType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cirrus</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vmvga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>qxl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>none</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>bochs</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>ramfb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </video>
Apr 11 19:17:33 user nova-compute[82196]:     <hostdev supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='mode'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>subsystem</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='startupPolicy'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>default</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>mandatory</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>requisite</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>optional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='subsysType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pci</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='capsType'/>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='pciBackend'/>
Apr 11 19:17:33 user nova-compute[82196]:     </hostdev>
Apr 11 19:17:33 user nova-compute[82196]:     <rng supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>random</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egd</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>builtin</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </rng>
Apr 11 19:17:33 user nova-compute[82196]:     <filesystem supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='driverType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>path</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>handle</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtiofs</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </filesystem>
Apr 11 19:17:33 user nova-compute[82196]:     <tpm supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-tis</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-crb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>passthrough</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>emulator</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </tpm>
Apr 11 19:17:33 user nova-compute[82196]:   </devices>
Apr 11 19:17:33 user nova-compute[82196]:   <features>
Apr 11 19:17:33 user nova-compute[82196]:     <gic supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     <vmcoreinfo supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <genid supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backingStoreInput supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backup supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <sev supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:   </features>
Apr 11 19:17:33 user nova-compute[82196]: </domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:  {{(pid=82196) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 11 19:17:33 user nova-compute[82196]: <domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 19:17:33 user nova-compute[82196]:   <domain>kvm</domain>
Apr 11 19:17:33 user nova-compute[82196]:   <machine>pc-q35-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:   <arch>i686</arch>
Apr 11 19:17:33 user nova-compute[82196]:   <vcpu max='288'/>
Apr 11 19:17:33 user nova-compute[82196]:   <iothreads supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:   <os supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='firmware'/>
Apr 11 19:17:33 user nova-compute[82196]:     <loader supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>rom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pflash</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='readonly'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>yes</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='secure'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </loader>
Apr 11 19:17:33 user nova-compute[82196]:   </os>
Apr 11 19:17:33 user nova-compute[82196]:   <cpu>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-passthrough' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='hostPassthroughMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='maximum' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='maximumMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>on</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-model' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <vendor>Intel</vendor>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ss'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='vmx'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='pcid'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='hypervisor'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arat'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='umip'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='md-clear'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibpb'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibrs'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='erms'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='lm'/>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='custom' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>qemu64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>qemu32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>phenom</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>n270</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>kvm64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>kvm32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>coreduo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>core2duo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>athlon</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Westmere</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Snowridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Penryn</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G5</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G4</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G1</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Nehalem</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Rome</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Milan</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Dhyana</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cooperlake</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Conroe</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>486</model>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:   </cpu>
Apr 11 19:17:33 user nova-compute[82196]:   <memoryBacking supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='sourceType'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>file</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>anonymous</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>memfd</value>
Apr 11 19:17:33 user nova-compute[82196]:     </enum>
Apr 11 19:17:33 user nova-compute[82196]:   </memoryBacking>
Apr 11 19:17:33 user nova-compute[82196]:   <devices>
Apr 11 19:17:33 user nova-compute[82196]:     <disk supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='diskDevice'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>disk</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cdrom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>floppy</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>lun</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='bus'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>fdc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sata</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </disk>
Apr 11 19:17:33 user nova-compute[82196]:     <graphics supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sdl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vnc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>spice</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egl-headless</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </graphics>
Apr 11 19:17:33 user nova-compute[82196]:     <video supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='modelType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cirrus</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vmvga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>qxl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>none</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>bochs</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>ramfb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </video>
Apr 11 19:17:33 user nova-compute[82196]:     <hostdev supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='mode'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>subsystem</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='startupPolicy'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>default</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>mandatory</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>requisite</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>optional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='subsysType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pci</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='capsType'/>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='pciBackend'/>
Apr 11 19:17:33 user nova-compute[82196]:     </hostdev>
Apr 11 19:17:33 user nova-compute[82196]:     <rng supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>random</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egd</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>builtin</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </rng>
Apr 11 19:17:33 user nova-compute[82196]:     <filesystem supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='driverType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>path</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>handle</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtiofs</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </filesystem>
Apr 11 19:17:33 user nova-compute[82196]:     <tpm supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-tis</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-crb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>passthrough</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>emulator</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </tpm>
Apr 11 19:17:33 user nova-compute[82196]:   </devices>
Apr 11 19:17:33 user nova-compute[82196]:   <features>
Apr 11 19:17:33 user nova-compute[82196]:     <gic supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     <vmcoreinfo supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <genid supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backingStoreInput supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backup supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <sev supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:   </features>
Apr 11 19:17:33 user nova-compute[82196]: </domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:  {{(pid=82196) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 11 19:17:33 user nova-compute[82196]: <domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 19:17:33 user nova-compute[82196]:   <domain>kvm</domain>
Apr 11 19:17:33 user nova-compute[82196]:   <machine>pc-i440fx-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:   <arch>i686</arch>
Apr 11 19:17:33 user nova-compute[82196]:   <vcpu max='255'/>
Apr 11 19:17:33 user nova-compute[82196]:   <iothreads supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:   <os supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='firmware'/>
Apr 11 19:17:33 user nova-compute[82196]:     <loader supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>rom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pflash</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='readonly'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>yes</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='secure'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </loader>
Apr 11 19:17:33 user nova-compute[82196]:   </os>
Apr 11 19:17:33 user nova-compute[82196]:   <cpu>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-passthrough' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='hostPassthroughMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='maximum' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='maximumMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>on</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-model' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <vendor>Intel</vendor>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ss'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='vmx'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='pcid'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='hypervisor'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arat'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='umip'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='md-clear'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibpb'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibrs'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='erms'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='lm'/>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='custom' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>qemu64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>qemu32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>phenom</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>n270</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>kvm64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>kvm32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>coreduo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>core2duo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>athlon</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Westmere</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Snowridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Penryn</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G5</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G4</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G1</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Nehalem</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Rome</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Milan</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Dhyana</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cooperlake</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Conroe</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>486</model>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:   </cpu>
Apr 11 19:17:33 user nova-compute[82196]:   <memoryBacking supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='sourceType'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>file</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>anonymous</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>memfd</value>
Apr 11 19:17:33 user nova-compute[82196]:     </enum>
Apr 11 19:17:33 user nova-compute[82196]:   </memoryBacking>
Apr 11 19:17:33 user nova-compute[82196]:   <devices>
Apr 11 19:17:33 user nova-compute[82196]:     <disk supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='diskDevice'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>disk</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cdrom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>floppy</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>lun</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='bus'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>ide</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>fdc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sata</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </disk>
Apr 11 19:17:33 user nova-compute[82196]:     <graphics supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sdl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vnc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>spice</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egl-headless</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </graphics>
Apr 11 19:17:33 user nova-compute[82196]:     <video supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='modelType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cirrus</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vmvga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>qxl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>none</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>bochs</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>ramfb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </video>
Apr 11 19:17:33 user nova-compute[82196]:     <hostdev supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='mode'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>subsystem</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='startupPolicy'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>default</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>mandatory</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>requisite</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>optional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='subsysType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pci</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='capsType'/>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='pciBackend'/>
Apr 11 19:17:33 user nova-compute[82196]:     </hostdev>
Apr 11 19:17:33 user nova-compute[82196]:     <rng supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>random</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egd</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>builtin</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </rng>
Apr 11 19:17:33 user nova-compute[82196]:     <filesystem supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='driverType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>path</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>handle</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtiofs</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </filesystem>
Apr 11 19:17:33 user nova-compute[82196]:     <tpm supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-tis</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-crb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>passthrough</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>emulator</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </tpm>
Apr 11 19:17:33 user nova-compute[82196]:   </devices>
Apr 11 19:17:33 user nova-compute[82196]:   <features>
Apr 11 19:17:33 user nova-compute[82196]:     <gic supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     <vmcoreinfo supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <genid supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backingStoreInput supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backup supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <sev supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:   </features>
Apr 11 19:17:33 user nova-compute[82196]: </domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:  {{(pid=82196) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 11 19:17:33 user nova-compute[82196]: <domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 19:17:33 user nova-compute[82196]:   <domain>kvm</domain>
Apr 11 19:17:33 user nova-compute[82196]:   <machine>pc-q35-jammy</machine>
Apr 11 19:17:33 user nova-compute[82196]:   <arch>i686</arch>
Apr 11 19:17:33 user nova-compute[82196]:   <vcpu max='288'/>
Apr 11 19:17:33 user nova-compute[82196]:   <iothreads supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:   <os supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='firmware'/>
Apr 11 19:17:33 user nova-compute[82196]:     <loader supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>rom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pflash</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='readonly'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>yes</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='secure'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </loader>
Apr 11 19:17:33 user nova-compute[82196]:   </os>
Apr 11 19:17:33 user nova-compute[82196]:   <cpu>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-passthrough' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='hostPassthroughMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='maximum' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='maximumMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>on</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-model' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <vendor>Intel</vendor>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ss'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='vmx'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='pcid'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='hypervisor'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arat'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='umip'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='md-clear'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibpb'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibrs'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='erms'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='lm'/>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='custom' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>qemu64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>qemu32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>phenom</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>n270</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>kvm64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>kvm32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>coreduo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>core2duo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>athlon</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Westmere</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Snowridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Penryn</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G5</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G4</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G1</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Nehalem</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Rome</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Milan</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Dhyana</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cooperlake</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Conroe</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>486</model>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:   </cpu>
Apr 11 19:17:33 user nova-compute[82196]:   <memoryBacking supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='sourceType'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>file</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>anonymous</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>memfd</value>
Apr 11 19:17:33 user nova-compute[82196]:     </enum>
Apr 11 19:17:33 user nova-compute[82196]:   </memoryBacking>
Apr 11 19:17:33 user nova-compute[82196]:   <devices>
Apr 11 19:17:33 user nova-compute[82196]:     <disk supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='diskDevice'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>disk</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cdrom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>floppy</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>lun</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='bus'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>fdc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sata</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </disk>
Apr 11 19:17:33 user nova-compute[82196]:     <graphics supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sdl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vnc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>spice</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egl-headless</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </graphics>
Apr 11 19:17:33 user nova-compute[82196]:     <video supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='modelType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cirrus</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vmvga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>qxl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>none</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>bochs</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>ramfb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </video>
Apr 11 19:17:33 user nova-compute[82196]:     <hostdev supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='mode'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>subsystem</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='startupPolicy'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>default</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>mandatory</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>requisite</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>optional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='subsysType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pci</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='capsType'/>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='pciBackend'/>
Apr 11 19:17:33 user nova-compute[82196]:     </hostdev>
Apr 11 19:17:33 user nova-compute[82196]:     <rng supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>random</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egd</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>builtin</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </rng>
Apr 11 19:17:33 user nova-compute[82196]:     <filesystem supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='driverType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>path</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>handle</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtiofs</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </filesystem>
Apr 11 19:17:33 user nova-compute[82196]:     <tpm supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-tis</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-crb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>passthrough</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>emulator</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </tpm>
Apr 11 19:17:33 user nova-compute[82196]:   </devices>
Apr 11 19:17:33 user nova-compute[82196]:   <features>
Apr 11 19:17:33 user nova-compute[82196]:     <gic supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     <vmcoreinfo supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <genid supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backingStoreInput supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backup supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <sev supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:   </features>
Apr 11 19:17:33 user nova-compute[82196]: </domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:  {{(pid=82196) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for mips via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 11 19:17:33 user nova-compute[82196]: <domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 19:17:33 user nova-compute[82196]:   <domain>kvm</domain>
Apr 11 19:17:33 user nova-compute[82196]:   <machine>pc-i440fx-jammy</machine>
Apr 11 19:17:33 user nova-compute[82196]:   <arch>x86_64</arch>
Apr 11 19:17:33 user nova-compute[82196]:   <vcpu max='255'/>
Apr 11 19:17:33 user nova-compute[82196]:   <iothreads supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:   <os supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='firmware'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>efi</value>
Apr 11 19:17:33 user nova-compute[82196]:     </enum>
Apr 11 19:17:33 user nova-compute[82196]:     <loader supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>rom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pflash</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='readonly'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>yes</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='secure'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </loader>
Apr 11 19:17:33 user nova-compute[82196]:   </os>
Apr 11 19:17:33 user nova-compute[82196]:   <cpu>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-passthrough' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='hostPassthroughMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>on</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='maximum' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='maximumMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>on</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-model' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <vendor>Intel</vendor>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ss'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='vmx'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='pcid'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='hypervisor'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arat'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='umip'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='md-clear'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='invtsc'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibpb'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibrs'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='rsba'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='erms'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='custom' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>qemu64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>qemu32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>phenom</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>n270</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>kvm64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>kvm32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>coreduo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>core2duo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>athlon</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Westmere</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Snowridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Penryn</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G5</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G4</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Opteron_G1</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Nehalem</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Rome</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Milan</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Dhyana</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cooperlake</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Conroe</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>486</model>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:   </cpu>
Apr 11 19:17:33 user nova-compute[82196]:   <memoryBacking supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='sourceType'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>file</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>anonymous</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>memfd</value>
Apr 11 19:17:33 user nova-compute[82196]:     </enum>
Apr 11 19:17:33 user nova-compute[82196]:   </memoryBacking>
Apr 11 19:17:33 user nova-compute[82196]:   <devices>
Apr 11 19:17:33 user nova-compute[82196]:     <disk supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='diskDevice'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>disk</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cdrom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>floppy</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>lun</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='bus'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>ide</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>fdc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sata</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </disk>
Apr 11 19:17:33 user nova-compute[82196]:     <graphics supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sdl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vnc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>spice</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egl-headless</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </graphics>
Apr 11 19:17:33 user nova-compute[82196]:     <video supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='modelType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cirrus</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vmvga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>qxl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>none</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>bochs</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>ramfb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </video>
Apr 11 19:17:33 user nova-compute[82196]:     <hostdev supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='mode'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>subsystem</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='startupPolicy'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>default</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>mandatory</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>requisite</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>optional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='subsysType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pci</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='capsType'/>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='pciBackend'/>
Apr 11 19:17:33 user nova-compute[82196]:     </hostdev>
Apr 11 19:17:33 user nova-compute[82196]:     <rng supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>random</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egd</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>builtin</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </rng>
Apr 11 19:17:33 user nova-compute[82196]:     <filesystem supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='driverType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>path</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>handle</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtiofs</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </filesystem>
Apr 11 19:17:33 user nova-compute[82196]:     <tpm supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-tis</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-crb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>passthrough</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>emulator</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </tpm>
Apr 11 19:17:33 user nova-compute[82196]:   </devices>
Apr 11 19:17:33 user nova-compute[82196]:   <features>
Apr 11 19:17:33 user nova-compute[82196]:     <gic supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     <vmcoreinfo supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <genid supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backingStoreInput supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backup supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <sev supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:   </features>
Apr 11 19:17:33 user nova-compute[82196]: </domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:  {{(pid=82196) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 11 19:17:33 user nova-compute[82196]: <domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 19:17:33 user nova-compute[82196]:   <domain>kvm</domain>
Apr 11 19:17:33 user nova-compute[82196]:   <machine>pc-q35-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:   <arch>x86_64</arch>
Apr 11 19:17:33 user nova-compute[82196]:   <vcpu max='288'/>
Apr 11 19:17:33 user nova-compute[82196]:   <iothreads supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:   <os supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='firmware'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>efi</value>
Apr 11 19:17:33 user nova-compute[82196]:     </enum>
Apr 11 19:17:33 user nova-compute[82196]:     <loader supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>rom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pflash</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='readonly'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>yes</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='secure'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>yes</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </loader>
Apr 11 19:17:33 user nova-compute[82196]:   </os>
Apr 11 19:17:33 user nova-compute[82196]:   <cpu>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-passthrough' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='hostPassthroughMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>on</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='maximum' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='maximumMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>on</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-model' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <vendor>Intel</vendor>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ss'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='vmx'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='pcid'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='hypervisor'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arat'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='umip'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='md-clear'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='invtsc'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibpb'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibrs'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='rsba'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='erms'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='custom' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>qemu64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>qemu32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>phenom</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>n270</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>kvm64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>kvm32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>coreduo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>core2duo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>athlon</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Westmere</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Snowridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Penryn</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G5</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G4</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Opteron_G1</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Nehalem</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Rome</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Milan</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Dhyana</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cooperlake</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Conroe</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>486</model>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:   </cpu>
Apr 11 19:17:33 user nova-compute[82196]:   <memoryBacking supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='sourceType'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>file</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>anonymous</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>memfd</value>
Apr 11 19:17:33 user nova-compute[82196]:     </enum>
Apr 11 19:17:33 user nova-compute[82196]:   </memoryBacking>
Apr 11 19:17:33 user nova-compute[82196]:   <devices>
Apr 11 19:17:33 user nova-compute[82196]:     <disk supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='diskDevice'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>disk</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cdrom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>floppy</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>lun</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='bus'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>fdc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sata</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </disk>
Apr 11 19:17:33 user nova-compute[82196]:     <graphics supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sdl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vnc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>spice</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egl-headless</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </graphics>
Apr 11 19:17:33 user nova-compute[82196]:     <video supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='modelType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cirrus</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vmvga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>qxl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>none</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>bochs</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>ramfb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </video>
Apr 11 19:17:33 user nova-compute[82196]:     <hostdev supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='mode'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>subsystem</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='startupPolicy'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>default</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>mandatory</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>requisite</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>optional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='subsysType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pci</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='capsType'/>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='pciBackend'/>
Apr 11 19:17:33 user nova-compute[82196]:     </hostdev>
Apr 11 19:17:33 user nova-compute[82196]:     <rng supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>random</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egd</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>builtin</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </rng>
Apr 11 19:17:33 user nova-compute[82196]:     <filesystem supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='driverType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>path</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>handle</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtiofs</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </filesystem>
Apr 11 19:17:33 user nova-compute[82196]:     <tpm supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-tis</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-crb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>passthrough</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>emulator</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </tpm>
Apr 11 19:17:33 user nova-compute[82196]:   </devices>
Apr 11 19:17:33 user nova-compute[82196]:   <features>
Apr 11 19:17:33 user nova-compute[82196]:     <gic supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     <vmcoreinfo supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <genid supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backingStoreInput supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backup supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <sev supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:   </features>
Apr 11 19:17:33 user nova-compute[82196]: </domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:  {{(pid=82196) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 11 19:17:33 user nova-compute[82196]: <domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 19:17:33 user nova-compute[82196]:   <domain>kvm</domain>
Apr 11 19:17:33 user nova-compute[82196]:   <machine>pc-i440fx-6.2</machine>
Apr 11 19:17:33 user nova-compute[82196]:   <arch>x86_64</arch>
Apr 11 19:17:33 user nova-compute[82196]:   <vcpu max='255'/>
Apr 11 19:17:33 user nova-compute[82196]:   <iothreads supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:   <os supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='firmware'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>efi</value>
Apr 11 19:17:33 user nova-compute[82196]:     </enum>
Apr 11 19:17:33 user nova-compute[82196]:     <loader supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>rom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pflash</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='readonly'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>yes</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='secure'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </loader>
Apr 11 19:17:33 user nova-compute[82196]:   </os>
Apr 11 19:17:33 user nova-compute[82196]:   <cpu>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-passthrough' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='hostPassthroughMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>on</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='maximum' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='maximumMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>on</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-model' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <vendor>Intel</vendor>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ss'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='vmx'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='pcid'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='hypervisor'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arat'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='umip'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='md-clear'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='invtsc'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibpb'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibrs'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='rsba'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='erms'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='custom' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>qemu64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>qemu32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>phenom</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>n270</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>kvm64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>kvm32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>coreduo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>core2duo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>athlon</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Westmere</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Snowridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Penryn</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G5</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G4</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Opteron_G1</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Nehalem</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Rome</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Milan</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Dhyana</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cooperlake</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Conroe</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>486</model>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:   </cpu>
Apr 11 19:17:33 user nova-compute[82196]:   <memoryBacking supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='sourceType'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>file</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>anonymous</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>memfd</value>
Apr 11 19:17:33 user nova-compute[82196]:     </enum>
Apr 11 19:17:33 user nova-compute[82196]:   </memoryBacking>
Apr 11 19:17:33 user nova-compute[82196]:   <devices>
Apr 11 19:17:33 user nova-compute[82196]:     <disk supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='diskDevice'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>disk</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cdrom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>floppy</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>lun</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='bus'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>ide</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>fdc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sata</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </disk>
Apr 11 19:17:33 user nova-compute[82196]:     <graphics supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sdl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vnc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>spice</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egl-headless</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </graphics>
Apr 11 19:17:33 user nova-compute[82196]:     <video supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='modelType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cirrus</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vmvga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>qxl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>none</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>bochs</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>ramfb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </video>
Apr 11 19:17:33 user nova-compute[82196]:     <hostdev supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='mode'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>subsystem</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='startupPolicy'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>default</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>mandatory</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>requisite</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>optional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='subsysType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pci</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='capsType'/>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='pciBackend'/>
Apr 11 19:17:33 user nova-compute[82196]:     </hostdev>
Apr 11 19:17:33 user nova-compute[82196]:     <rng supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>random</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egd</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>builtin</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </rng>
Apr 11 19:17:33 user nova-compute[82196]:     <filesystem supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='driverType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>path</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>handle</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtiofs</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </filesystem>
Apr 11 19:17:33 user nova-compute[82196]:     <tpm supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-tis</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-crb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>passthrough</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>emulator</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </tpm>
Apr 11 19:17:33 user nova-compute[82196]:   </devices>
Apr 11 19:17:33 user nova-compute[82196]:   <features>
Apr 11 19:17:33 user nova-compute[82196]:     <gic supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     <vmcoreinfo supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <genid supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backingStoreInput supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backup supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <sev supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:   </features>
Apr 11 19:17:33 user nova-compute[82196]: </domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:  {{(pid=82196) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 11 19:17:33 user nova-compute[82196]: <domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 19:17:33 user nova-compute[82196]:   <domain>kvm</domain>
Apr 11 19:17:33 user nova-compute[82196]:   <machine>pc-q35-jammy</machine>
Apr 11 19:17:33 user nova-compute[82196]:   <arch>x86_64</arch>
Apr 11 19:17:33 user nova-compute[82196]:   <vcpu max='288'/>
Apr 11 19:17:33 user nova-compute[82196]:   <iothreads supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:   <os supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='firmware'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>efi</value>
Apr 11 19:17:33 user nova-compute[82196]:     </enum>
Apr 11 19:17:33 user nova-compute[82196]:     <loader supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>rom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pflash</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='readonly'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>yes</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='secure'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>yes</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>no</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </loader>
Apr 11 19:17:33 user nova-compute[82196]:   </os>
Apr 11 19:17:33 user nova-compute[82196]:   <cpu>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-passthrough' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='hostPassthroughMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>on</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='maximum' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='maximumMigratable'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>on</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>off</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='host-model' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <vendor>Intel</vendor>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ss'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='vmx'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='pcid'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='hypervisor'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arat'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='umip'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='md-clear'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='invtsc'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibpb'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='ibrs'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-stibp'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='rsba'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='erms'/>
Apr 11 19:17:33 user nova-compute[82196]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:     <mode name='custom' supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>qemu64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>qemu32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>phenom</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>pentium</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>n270</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>kvm64</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>kvm32</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>coreduo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>core2duo</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>athlon</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Westmere</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Snowridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Skylake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>SandyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Penryn</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G5</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G4</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G3</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Opteron_G2</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Opteron_G1</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Nehalem</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>IvyBridge</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Icelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Haswell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Rome</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-Milan</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>EPYC</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Dhyana</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cooperlake</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>Conroe</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='no'>Broadwell</model>
Apr 11 19:17:33 user nova-compute[82196]:       <model usable='yes'>486</model>
Apr 11 19:17:33 user nova-compute[82196]:     </mode>
Apr 11 19:17:33 user nova-compute[82196]:   </cpu>
Apr 11 19:17:33 user nova-compute[82196]:   <memoryBacking supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:     <enum name='sourceType'>
Apr 11 19:17:33 user nova-compute[82196]:       <value>file</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>anonymous</value>
Apr 11 19:17:33 user nova-compute[82196]:       <value>memfd</value>
Apr 11 19:17:33 user nova-compute[82196]:     </enum>
Apr 11 19:17:33 user nova-compute[82196]:   </memoryBacking>
Apr 11 19:17:33 user nova-compute[82196]:   <devices>
Apr 11 19:17:33 user nova-compute[82196]:     <disk supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='diskDevice'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>disk</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cdrom</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>floppy</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>lun</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='bus'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>fdc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sata</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </disk>
Apr 11 19:17:33 user nova-compute[82196]:     <graphics supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='type'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>sdl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vnc</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>spice</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egl-headless</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </graphics>
Apr 11 19:17:33 user nova-compute[82196]:     <video supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='modelType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>cirrus</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>vmvga</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>qxl</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>none</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>bochs</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>ramfb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </video>
Apr 11 19:17:33 user nova-compute[82196]:     <hostdev supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='mode'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>subsystem</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='startupPolicy'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>default</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>mandatory</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>requisite</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>optional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='subsysType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>usb</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>pci</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>scsi</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='capsType'/>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='pciBackend'/>
Apr 11 19:17:33 user nova-compute[82196]:     </hostdev>
Apr 11 19:17:33 user nova-compute[82196]:     <rng supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtio-non-transitional</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>random</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>egd</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>builtin</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </rng>
Apr 11 19:17:33 user nova-compute[82196]:     <filesystem supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='driverType'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>path</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>handle</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>virtiofs</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </filesystem>
Apr 11 19:17:33 user nova-compute[82196]:     <tpm supported='yes'>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='model'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-tis</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>tpm-crb</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:       <enum name='backendModel'>
Apr 11 19:17:33 user nova-compute[82196]:         <value>passthrough</value>
Apr 11 19:17:33 user nova-compute[82196]:         <value>emulator</value>
Apr 11 19:17:33 user nova-compute[82196]:       </enum>
Apr 11 19:17:33 user nova-compute[82196]:     </tpm>
Apr 11 19:17:33 user nova-compute[82196]:   </devices>
Apr 11 19:17:33 user nova-compute[82196]:   <features>
Apr 11 19:17:33 user nova-compute[82196]:     <gic supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:     <vmcoreinfo supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <genid supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backingStoreInput supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <backup supported='yes'/>
Apr 11 19:17:33 user nova-compute[82196]:     <sev supported='no'/>
Apr 11 19:17:33 user nova-compute[82196]:   </features>
Apr 11 19:17:33 user nova-compute[82196]: </domainCapabilities>
Apr 11 19:17:33 user nova-compute[82196]:  {{(pid=82196) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=82196) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=82196) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Checking secure boot support for host arch (x86_64) {{(pid=82196) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Checking secure boot support for host arch (x86_64) {{(pid=82196) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Checking secure boot support for host arch (x86_64) {{(pid=82196) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 19:17:33 user nova-compute[82196]: INFO nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Secure Boot support detected
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] cpu compare xml: <cpu match="exact">
Apr 11 19:17:33 user nova-compute[82196]:   <model>Nehalem</model>
Apr 11 19:17:33 user nova-compute[82196]: </cpu>
Apr 11 19:17:33 user nova-compute[82196]:  {{(pid=82196) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 11 19:17:33 user nova-compute[82196]: INFO nova.virt.node [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Generated node identity 05f5e47c-70b3-42ff-8927-09fa1d35aec2
Apr 11 19:17:33 user nova-compute[82196]: INFO nova.virt.node [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Wrote node identity 05f5e47c-70b3-42ff-8927-09fa1d35aec2 to /opt/stack/data/nova/compute_id
Apr 11 19:17:33 user nova-compute[82196]: WARNING nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Compute nodes ['05f5e47c-70b3-42ff-8927-09fa1d35aec2'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 11 19:17:33 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 11 19:17:33 user nova-compute[82196]: WARNING nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 19:17:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:17:33 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:17:33 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:17:33 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Hypervisor/Node resource view: name=user free_ram=10806MB free_disk=27.161495208740234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:17:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:17:33 user nova-compute[82196]: WARNING nova.compute.resource_tracker [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] No compute node record for user:05f5e47c-70b3-42ff-8927-09fa1d35aec2: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 05f5e47c-70b3-42ff-8927-09fa1d35aec2 could not be found.
Apr 11 19:17:33 user nova-compute[82196]: INFO nova.compute.resource_tracker [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Compute node record created for user:user with uuid: 05f5e47c-70b3-42ff-8927-09fa1d35aec2
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:17:34 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [req-26755947-0fa1-45dd-a430-7152cba55c04] Created resource provider record via placement API for resource provider with UUID 05f5e47c-70b3-42ff-8927-09fa1d35aec2 and name user.
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=82196) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 11 19:17:34 user nova-compute[82196]: INFO nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] kernel doesn't support AMD SEV
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Updating inventory in ProviderTree for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Libvirt baseline CPU <cpu>
Apr 11 19:17:34 user nova-compute[82196]:   <arch>x86_64</arch>
Apr 11 19:17:34 user nova-compute[82196]:   <model>Nehalem</model>
Apr 11 19:17:34 user nova-compute[82196]:   <vendor>Intel</vendor>
Apr 11 19:17:34 user nova-compute[82196]:   <topology sockets="6" cores="1" threads="1"/>
Apr 11 19:17:34 user nova-compute[82196]: </cpu>
Apr 11 19:17:34 user nova-compute[82196]:  {{(pid=82196) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Updated inventory for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Updating resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 generation from 0 to 1 during operation: update_inventory {{(pid=82196) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Updating inventory in ProviderTree for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Updating resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 generation from 1 to 2 during operation: update_traits {{(pid=82196) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:17:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.service [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Creating RPC server for service compute {{(pid=82196) start /opt/stack/nova/nova/service.py:182}}
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.service [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Join ServiceGroup membership for this service compute {{(pid=82196) start /opt/stack/nova/nova/service.py:199}}
Apr 11 19:17:34 user nova-compute[82196]: DEBUG nova.servicegroup.drivers.db [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=82196) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 11 19:18:00 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:18:00 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Didn't find any instances for network info cache update. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:18:25 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:18:25 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:18:25 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=10193MB free_disk=27.075313568115234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:18:25 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:18:26 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:18:26 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:18:26 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:18:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:19:26 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:19:26 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:19:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:19:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:19:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Didn't find any instances for network info cache update. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 19:19:26 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:19:26 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:19:26 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:19:26 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:19:27 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:19:27 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:19:27 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=10160MB free_disk=27.12109375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:19:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:20:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:20:26 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:20:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:20:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:20:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Didn't find any instances for network info cache update. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 19:20:26 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:20:27 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:20:27 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:20:28 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:20:28 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:20:28 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:20:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:20:29 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:20:29 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:20:29 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=10190MB free_disk=26.897411346435547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:20:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:21:26 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:21:26 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:21:27 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:21:28 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:21:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:21:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:21:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Didn't find any instances for network info cache update. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 19:21:28 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:21:28 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:21:28 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:21:30 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:21:30 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:21:30 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=9410MB free_disk=26.920207977294922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:21:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:21:38 user nova-compute[82196]: INFO nova.compute.claims [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Claim successful on node user
Apr 11 19:21:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.297s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:21:38 user nova-compute[82196]: INFO nova.compute.claims [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Claim successful on node user
Apr 11 19:21:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG nova.network.neutron [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:21:38 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:21:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:21:38 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:21:39 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Creating image(s)
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "/opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "/opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.network.neutron [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:21:39 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9.part --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.policy [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f44dfa2528b4540a81f4eb7c3f3f2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5d7769df1e4974b295cb30407151dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:21:39 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Creating image(s)
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "/opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "/opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "/opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9.part --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.virt.images [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] 4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b was qcow2, converting to raw {{(pid=82196) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9.part /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9.converted {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG nova.policy [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '502b859ece744cf680123cd4e9643938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34322e02b2fc4c2c84fb77583faf4405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9.part /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9.converted" returned: 0 in 0.233s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9.converted --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.089s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:40 user nova-compute[82196]: INFO oslo.privsep.daemon [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpj9p21co1/privsep.sock']
Apr 11 19:21:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.608s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:40 user sudo[90965]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpj9p21co1/privsep.sock
Apr 11 19:21:40 user sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 19:21:41 user sudo[90965]: pam_unix(sudo:session): session closed for user root
Apr 11 19:21:41 user nova-compute[82196]: INFO oslo.privsep.daemon [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Spawned new privsep daemon via rootwrap
Apr 11 19:21:41 user nova-compute[82196]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 19:21:41 user nova-compute[82196]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 19:21:41 user nova-compute[82196]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 11 19:21:41 user nova-compute[82196]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91023
Apr 11 19:21:41 user nova-compute[82196]: WARNING oslo_privsep.priv_context [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] privsep daemon already running
Apr 11 19:21:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.128s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk 1073741824" returned: 0 in 0.048s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.161s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG nova.network.neutron [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Successfully created port: b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.127s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.157s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk 1073741824" returned: 0 in 0.060s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Cannot resize image /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lazy-loading 'migration_context' on Instance uuid efd7afec-d6d0-4e3f-a3b9-f672b3e711cf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Ensure instance console log exists: /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG nova.network.neutron [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Successfully created port: 096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Cannot resize image /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lazy-loading 'migration_context' on Instance uuid fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Ensure instance console log exists: /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Successfully updated port: 096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "refresh_cache-efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquired lock "refresh_cache-efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:21:45 user nova-compute[82196]: INFO nova.compute.claims [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Claim successful on node user
Apr 11 19:21:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Successfully updated port: b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "refresh_cache-fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquired lock "refresh_cache-fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG nova.compute.manager [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Received event network-changed-096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG nova.compute.manager [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Refreshing instance network info cache due to event network-changed-096d6451-049b-4ff5-9eaf-8ee3884c8715. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] Acquiring lock "refresh_cache-efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:45 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.network.neutron [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:21:46 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.network.neutron [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:21:46 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Creating image(s)
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "/opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "/opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "/opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.network.neutron [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Updating instance_info_cache with network_info: [{"id": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "address": "fa:16:3e:6a:84:54", "network": {"id": "ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-452666997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34322e02b2fc4c2c84fb77583faf4405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096d6451-04", "ovs_interfaceid": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Received event network-changed-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Refreshing instance network info cache due to event network-changed-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] Acquiring lock "refresh_cache-fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.policy [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Releasing lock "refresh_cache-efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Instance network_info: |[{"id": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "address": "fa:16:3e:6a:84:54", "network": {"id": "ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-452666997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34322e02b2fc4c2c84fb77583faf4405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096d6451-04", "ovs_interfaceid": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] Acquired lock "refresh_cache-efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.network.neutron [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Refreshing network info cache for port 096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Start _get_guest_xml network_info=[{"id": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "address": "fa:16:3e:6a:84:54", "network": {"id": "ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-452666997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34322e02b2fc4c2c84fb77583faf4405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096d6451-04", "ovs_interfaceid": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk 1073741824" returned: 0 in 0.044s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:46 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:21:46 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1799394439',display_name='tempest-DeleteServersTestJSON-server-1799394439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1799394439',id=2,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34322e02b2fc4c2c84fb77583faf4405',ramdisk_id='',reservation_id='r-ohtxvv2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-124461992',owner_user_name='tempest-DeleteServersTestJSON-124461992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:21:39Z,user_data=None,user_id='502b859ece744cf680123cd4e9643938',uuid=efd7afec-d6d0-4e3f-a3b9-f672b3e711cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "address": "fa:16:3e:6a:84:54", "network": {"id": "ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-452666997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34322e02b2fc4c2c84fb77583faf4405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096d6451-04", "ovs_interfaceid": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Converting VIF {"id": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "address": "fa:16:3e:6a:84:54", "network": {"id": "ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-452666997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34322e02b2fc4c2c84fb77583faf4405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096d6451-04", "ovs_interfaceid": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:84:54,bridge_name='br-int',has_traffic_filtering=True,id=096d6451-049b-4ff5-9eaf-8ee3884c8715,network=Network(ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096d6451-04') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.objects.instance [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lazy-loading 'pci_devices' on Instance uuid efd7afec-d6d0-4e3f-a3b9-f672b3e711cf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:21:46 user nova-compute[82196]:   <uuid>efd7afec-d6d0-4e3f-a3b9-f672b3e711cf</uuid>
Apr 11 19:21:46 user nova-compute[82196]:   <name>instance-00000002</name>
Apr 11 19:21:46 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:21:46 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:21:46 user nova-compute[82196]:   <metadata>
Apr 11 19:21:46 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:21:46 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:21:46 user nova-compute[82196]:       <nova:name>tempest-DeleteServersTestJSON-server-1799394439</nova:name>
Apr 11 19:21:46 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:21:46</nova:creationTime>
Apr 11 19:21:46 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:21:46 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:21:46 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:21:46 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:21:46 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:21:46 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:21:46 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:21:46 user nova-compute[82196]:       <nova:owner>
Apr 11 19:21:46 user nova-compute[82196]:         <nova:user uuid="502b859ece744cf680123cd4e9643938">tempest-DeleteServersTestJSON-124461992-project-member</nova:user>
Apr 11 19:21:46 user nova-compute[82196]:         <nova:project uuid="34322e02b2fc4c2c84fb77583faf4405">tempest-DeleteServersTestJSON-124461992</nova:project>
Apr 11 19:21:46 user nova-compute[82196]:       </nova:owner>
Apr 11 19:21:46 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:21:46 user nova-compute[82196]:       <nova:ports>
Apr 11 19:21:46 user nova-compute[82196]:         <nova:port uuid="096d6451-049b-4ff5-9eaf-8ee3884c8715">
Apr 11 19:21:46 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 19:21:46 user nova-compute[82196]:         </nova:port>
Apr 11 19:21:46 user nova-compute[82196]:       </nova:ports>
Apr 11 19:21:46 user nova-compute[82196]:     </nova:instance>
Apr 11 19:21:46 user nova-compute[82196]:   </metadata>
Apr 11 19:21:46 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:21:46 user nova-compute[82196]:     <system>
Apr 11 19:21:46 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:21:46 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:21:46 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:21:46 user nova-compute[82196]:       <entry name="serial">efd7afec-d6d0-4e3f-a3b9-f672b3e711cf</entry>
Apr 11 19:21:46 user nova-compute[82196]:       <entry name="uuid">efd7afec-d6d0-4e3f-a3b9-f672b3e711cf</entry>
Apr 11 19:21:46 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:21:46 user nova-compute[82196]:     </system>
Apr 11 19:21:46 user nova-compute[82196]:   </sysinfo>
Apr 11 19:21:46 user nova-compute[82196]:   <os>
Apr 11 19:21:46 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:21:46 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:21:46 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:21:46 user nova-compute[82196]:   </os>
Apr 11 19:21:46 user nova-compute[82196]:   <features>
Apr 11 19:21:46 user nova-compute[82196]:     <acpi/>
Apr 11 19:21:46 user nova-compute[82196]:     <apic/>
Apr 11 19:21:46 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:21:46 user nova-compute[82196]:   </features>
Apr 11 19:21:46 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:21:46 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:21:46 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:21:46 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:21:46 user nova-compute[82196]:   </clock>
Apr 11 19:21:46 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:21:46 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:21:46 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:21:46 user nova-compute[82196]:   </cpu>
Apr 11 19:21:46 user nova-compute[82196]:   <devices>
Apr 11 19:21:46 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:21:46 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:21:46 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk"/>
Apr 11 19:21:46 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:21:46 user nova-compute[82196]:     </disk>
Apr 11 19:21:46 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:21:46 user nova-compute[82196]:       <mac address="fa:16:3e:6a:84:54"/>
Apr 11 19:21:46 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:21:46 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:21:46 user nova-compute[82196]:       <target dev="tap096d6451-04"/>
Apr 11 19:21:46 user nova-compute[82196]:     </interface>
Apr 11 19:21:46 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:21:46 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/console.log" append="off"/>
Apr 11 19:21:46 user nova-compute[82196]:     </serial>
Apr 11 19:21:46 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:21:46 user nova-compute[82196]:     <video>
Apr 11 19:21:46 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:21:46 user nova-compute[82196]:     </video>
Apr 11 19:21:46 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:21:46 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:21:46 user nova-compute[82196]:     </rng>
Apr 11 19:21:46 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:21:46 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:21:46 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:21:46 user nova-compute[82196]:     </memballoon>
Apr 11 19:21:46 user nova-compute[82196]:   </devices>
Apr 11 19:21:46 user nova-compute[82196]: </domain>
Apr 11 19:21:46 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1799394439',display_name='tempest-DeleteServersTestJSON-server-1799394439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1799394439',id=2,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34322e02b2fc4c2c84fb77583faf4405',ramdisk_id='',reservation_id='r-ohtxvv2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-124461992',owner_user_name='tempest-DeleteServersTestJSON-124461992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:21:39Z,user_data=None,user_id='502b859ece744cf680123cd4e9643938',uuid=efd7afec-d6d0-4e3f-a3b9-f672b3e711cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "address": "fa:16:3e:6a:84:54", "network": {"id": "ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-452666997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34322e02b2fc4c2c84fb77583faf4405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096d6451-04", "ovs_interfaceid": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Converting VIF {"id": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "address": "fa:16:3e:6a:84:54", "network": {"id": "ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-452666997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34322e02b2fc4c2c84fb77583faf4405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096d6451-04", "ovs_interfaceid": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:84:54,bridge_name='br-int',has_traffic_filtering=True,id=096d6451-049b-4ff5-9eaf-8ee3884c8715,network=Network(ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096d6451-04') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG os_vif [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:84:54,bridge_name='br-int',has_traffic_filtering=True,id=096d6451-049b-4ff5-9eaf-8ee3884c8715,network=Network(ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096d6451-04') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Created schema index Interface.name {{(pid=82196) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Created schema index Port.name {{(pid=82196) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Created schema index Bridge.name {{(pid=82196) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [POLLOUT] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.245s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:21:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:21:46 user nova-compute[82196]: INFO oslo.privsep.daemon [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpe67h_xpf/privsep.sock']
Apr 11 19:21:46 user sudo[91158]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpe67h_xpf/privsep.sock
Apr 11 19:21:46 user sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 19:21:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Cannot resize image /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.objects.instance [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'migration_context' on Instance uuid bed4001c-02c2-4c6b-84c8-61654df66d8b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Ensure instance console log exists: /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.network.neutron [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Updating instance_info_cache with network_info: [{"id": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "address": "fa:16:3e:c2:7d:b5", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4beb6cf-d1", "ovs_interfaceid": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Releasing lock "refresh_cache-fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.compute.manager [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Instance network_info: |[{"id": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "address": "fa:16:3e:c2:7d:b5", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4beb6cf-d1", "ovs_interfaceid": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] Acquired lock "refresh_cache-fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Refreshing network info cache for port b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Start _get_guest_xml network_info=[{"id": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "address": "fa:16:3e:c2:7d:b5", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4beb6cf-d1", "ovs_interfaceid": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:21:47 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:21:47 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1297415435',display_name='tempest-ServersNegativeTestJSON-server-1297415435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1297415435',id=1,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d5d7769df1e4974b295cb30407151dd',ramdisk_id='',reservation_id='r-tdu8k0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1311045721',owner_user_name='tempest-ServersNegativeTestJSON-1311045721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:21:39Z,user_data=None,user_id='2f44dfa2528b4540a81f4eb7c3f3f2f5',uuid=fc48e37f-8c00-4e48-bea3-f1c2e54d78b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "address": "fa:16:3e:c2:7d:b5", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4beb6cf-d1", "ovs_interfaceid": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Converting VIF {"id": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "address": "fa:16:3e:c2:7d:b5", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4beb6cf-d1", "ovs_interfaceid": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7d:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4beb6cf-d11a-487e-b95d-6adec8a8ee4d,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4beb6cf-d1') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.objects.instance [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lazy-loading 'pci_devices' on Instance uuid fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:21:47 user nova-compute[82196]:   <uuid>fc48e37f-8c00-4e48-bea3-f1c2e54d78b8</uuid>
Apr 11 19:21:47 user nova-compute[82196]:   <name>instance-00000001</name>
Apr 11 19:21:47 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:21:47 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:21:47 user nova-compute[82196]:   <metadata>
Apr 11 19:21:47 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:21:47 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:21:47 user nova-compute[82196]:       <nova:name>tempest-ServersNegativeTestJSON-server-1297415435</nova:name>
Apr 11 19:21:47 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:21:47</nova:creationTime>
Apr 11 19:21:47 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:21:47 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:21:47 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:21:47 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:21:47 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:21:47 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:21:47 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:21:47 user nova-compute[82196]:       <nova:owner>
Apr 11 19:21:47 user nova-compute[82196]:         <nova:user uuid="2f44dfa2528b4540a81f4eb7c3f3f2f5">tempest-ServersNegativeTestJSON-1311045721-project-member</nova:user>
Apr 11 19:21:47 user nova-compute[82196]:         <nova:project uuid="0d5d7769df1e4974b295cb30407151dd">tempest-ServersNegativeTestJSON-1311045721</nova:project>
Apr 11 19:21:47 user nova-compute[82196]:       </nova:owner>
Apr 11 19:21:47 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:21:47 user nova-compute[82196]:       <nova:ports>
Apr 11 19:21:47 user nova-compute[82196]:         <nova:port uuid="b4beb6cf-d11a-487e-b95d-6adec8a8ee4d">
Apr 11 19:21:47 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 19:21:47 user nova-compute[82196]:         </nova:port>
Apr 11 19:21:47 user nova-compute[82196]:       </nova:ports>
Apr 11 19:21:47 user nova-compute[82196]:     </nova:instance>
Apr 11 19:21:47 user nova-compute[82196]:   </metadata>
Apr 11 19:21:47 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:21:47 user nova-compute[82196]:     <system>
Apr 11 19:21:47 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:21:47 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:21:47 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:21:47 user nova-compute[82196]:       <entry name="serial">fc48e37f-8c00-4e48-bea3-f1c2e54d78b8</entry>
Apr 11 19:21:47 user nova-compute[82196]:       <entry name="uuid">fc48e37f-8c00-4e48-bea3-f1c2e54d78b8</entry>
Apr 11 19:21:47 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:21:47 user nova-compute[82196]:     </system>
Apr 11 19:21:47 user nova-compute[82196]:   </sysinfo>
Apr 11 19:21:47 user nova-compute[82196]:   <os>
Apr 11 19:21:47 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:21:47 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:21:47 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:21:47 user nova-compute[82196]:   </os>
Apr 11 19:21:47 user nova-compute[82196]:   <features>
Apr 11 19:21:47 user nova-compute[82196]:     <acpi/>
Apr 11 19:21:47 user nova-compute[82196]:     <apic/>
Apr 11 19:21:47 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:21:47 user nova-compute[82196]:   </features>
Apr 11 19:21:47 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:21:47 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:21:47 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:21:47 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:21:47 user nova-compute[82196]:   </clock>
Apr 11 19:21:47 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:21:47 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:21:47 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:21:47 user nova-compute[82196]:   </cpu>
Apr 11 19:21:47 user nova-compute[82196]:   <devices>
Apr 11 19:21:47 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:21:47 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:21:47 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk"/>
Apr 11 19:21:47 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:21:47 user nova-compute[82196]:     </disk>
Apr 11 19:21:47 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:21:47 user nova-compute[82196]:       <mac address="fa:16:3e:c2:7d:b5"/>
Apr 11 19:21:47 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:21:47 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:21:47 user nova-compute[82196]:       <target dev="tapb4beb6cf-d1"/>
Apr 11 19:21:47 user nova-compute[82196]:     </interface>
Apr 11 19:21:47 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:21:47 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/console.log" append="off"/>
Apr 11 19:21:47 user nova-compute[82196]:     </serial>
Apr 11 19:21:47 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:21:47 user nova-compute[82196]:     <video>
Apr 11 19:21:47 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:21:47 user nova-compute[82196]:     </video>
Apr 11 19:21:47 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:21:47 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:21:47 user nova-compute[82196]:     </rng>
Apr 11 19:21:47 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:21:47 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:21:47 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:21:47 user nova-compute[82196]:     </memballoon>
Apr 11 19:21:47 user nova-compute[82196]:   </devices>
Apr 11 19:21:47 user nova-compute[82196]: </domain>
Apr 11 19:21:47 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1297415435',display_name='tempest-ServersNegativeTestJSON-server-1297415435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1297415435',id=1,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d5d7769df1e4974b295cb30407151dd',ramdisk_id='',reservation_id='r-tdu8k0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1311045721',owner_user_name='tempest-ServersNegativeTestJSON-1311045721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:21:39Z,user_data=None,user_id='2f44dfa2528b4540a81f4eb7c3f3f2f5',uuid=fc48e37f-8c00-4e48-bea3-f1c2e54d78b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "address": "fa:16:3e:c2:7d:b5", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4beb6cf-d1", "ovs_interfaceid": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Converting VIF {"id": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "address": "fa:16:3e:c2:7d:b5", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4beb6cf-d1", "ovs_interfaceid": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7d:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4beb6cf-d11a-487e-b95d-6adec8a8ee4d,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4beb6cf-d1') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG os_vif [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7d:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4beb6cf-d11a-487e-b95d-6adec8a8ee4d,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4beb6cf-d1') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Updated VIF entry in instance network info cache for port 096d6451-049b-4ff5-9eaf-8ee3884c8715. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Updating instance_info_cache with network_info: [{"id": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "address": "fa:16:3e:6a:84:54", "network": {"id": "ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-452666997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34322e02b2fc4c2c84fb77583faf4405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096d6451-04", "ovs_interfaceid": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:21:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-760183a6-4985-4eb6-b665-3bcc1461902d req-0c2a0fbc-dacd-43e5-9efa-1472cd653dc1 service nova] Releasing lock "refresh_cache-efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:21:48 user sudo[91158]: pam_unix(sudo:session): session closed for user root
Apr 11 19:21:48 user nova-compute[82196]: INFO oslo.privsep.daemon [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Spawned new privsep daemon via rootwrap
Apr 11 19:21:48 user nova-compute[82196]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 19:21:48 user nova-compute[82196]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 19:21:48 user nova-compute[82196]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 11 19:21:48 user nova-compute[82196]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91174
Apr 11 19:21:48 user nova-compute[82196]: WARNING oslo_privsep.priv_context [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] privsep daemon already running
Apr 11 19:21:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4beb6cf-d1, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4beb6cf-d1, col_values=(('external_ids', {'iface-id': 'b4beb6cf-d11a-487e-b95d-6adec8a8ee4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:7d:b5', 'vm-uuid': 'fc48e37f-8c00-4e48-bea3-f1c2e54d78b8'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:49 user nova-compute[82196]: INFO os_vif [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7d:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4beb6cf-d11a-487e-b95d-6adec8a8ee4d,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4beb6cf-d1')
Apr 11 19:21:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap096d6451-04, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap096d6451-04, col_values=(('external_ids', {'iface-id': '096d6451-049b-4ff5-9eaf-8ee3884c8715', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:84:54', 'vm-uuid': 'efd7afec-d6d0-4e3f-a3b9-f672b3e711cf'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:49 user nova-compute[82196]: INFO os_vif [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:84:54,bridge_name='br-int',has_traffic_filtering=True,id=096d6451-049b-4ff5-9eaf-8ee3884c8715,network=Network(ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096d6451-04')
Apr 11 19:21:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] No VIF found with MAC fa:16:3e:c2:7d:b5, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] No VIF found with MAC fa:16:3e:6a:84:54, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG nova.network.neutron [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Updated VIF entry in instance network info cache for port b4beb6cf-d11a-487e-b95d-6adec8a8ee4d. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG nova.network.neutron [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Updating instance_info_cache with network_info: [{"id": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "address": "fa:16:3e:c2:7d:b5", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4beb6cf-d1", "ovs_interfaceid": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7fd52a62-c5b0-45c2-a14c-295fcd57dfbd req-17bd8f62-22e2-4cef-a05a-72c0689440ed service nova] Releasing lock "refresh_cache-fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:21:49 user nova-compute[82196]: DEBUG nova.network.neutron [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Successfully created port: b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:21:51 user nova-compute[82196]: INFO nova.compute.claims [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Claim successful on node user
Apr 11 19:21:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:21:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:21:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Creating image(s)
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "/opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "/opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.159s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-b8e776db-4646-4716-9736-7273550801d0 req-5abaabe2-e4c9-476e-877b-a9955381c045 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Received event network-vif-plugged-096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b8e776db-4646-4716-9736-7273550801d0 req-5abaabe2-e4c9-476e-877b-a9955381c045 service nova] Acquiring lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b8e776db-4646-4716-9736-7273550801d0 req-5abaabe2-e4c9-476e-877b-a9955381c045 service nova] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b8e776db-4646-4716-9736-7273550801d0 req-5abaabe2-e4c9-476e-877b-a9955381c045 service nova] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-b8e776db-4646-4716-9736-7273550801d0 req-5abaabe2-e4c9-476e-877b-a9955381c045 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] No waiting events found dispatching network-vif-plugged-096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:21:52 user nova-compute[82196]: WARNING nova.compute.manager [req-b8e776db-4646-4716-9736-7273550801d0 req-5abaabe2-e4c9-476e-877b-a9955381c045 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Received unexpected event network-vif-plugged-096d6451-049b-4ff5-9eaf-8ee3884c8715 for instance with vm_state building and task_state spawning.
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.162s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk 1073741824" returned: 0 in 0.069s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.policy [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26f091a1508b4d2689005b660f6a1380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee7c68b277420ba524c2a99cd444ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Successfully updated port: b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "refresh_cache-bed4001c-02c2-4c6b-84c8-61654df66d8b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquired lock "refresh_cache-bed4001c-02c2-4c6b-84c8-61654df66d8b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.229s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Received event network-vif-plugged-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] Acquiring lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] No waiting events found dispatching network-vif-plugged-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:21:52 user nova-compute[82196]: WARNING nova.compute.manager [req-fc2407b1-3791-4275-883e-1d0696cc4889 req-407c4af9-a564-443a-bc30-664d8ac417f6 service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Received unexpected event network-vif-plugged-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d for instance with vm_state building and task_state spawning.
Apr 11 19:21:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Cannot resize image /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'migration_context' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Ensure instance console log exists: /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Updating instance_info_cache with network_info: [{"id": "b644e09b-afb0-43e7-9773-0df435010320", "address": "fa:16:3e:16:ad:8e", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb644e09b-af", "ovs_interfaceid": "b644e09b-afb0-43e7-9773-0df435010320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Releasing lock "refresh_cache-bed4001c-02c2-4c6b-84c8-61654df66d8b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Instance network_info: |[{"id": "b644e09b-afb0-43e7-9773-0df435010320", "address": "fa:16:3e:16:ad:8e", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb644e09b-af", "ovs_interfaceid": "b644e09b-afb0-43e7-9773-0df435010320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Start _get_guest_xml network_info=[{"id": "b644e09b-afb0-43e7-9773-0df435010320", "address": "fa:16:3e:16:ad:8e", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb644e09b-af", "ovs_interfaceid": "b644e09b-afb0-43e7-9773-0df435010320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:21:53 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:21:53 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1923045055',display_name='tempest-AttachVolumeNegativeTest-server-1923045055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1923045055',id=3,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXl985Dnl44xCHtf4FIl1xYVxoZaplMJQzbwa3Y9N5KsJvliQVBgK4OaT/SgpGEh9Q8h4HPARqY2MPNwKL+8Ropi74fbtw+x6EYUP9DMyAquimJy9wP/Ns3xiePmd0rew==',key_name='tempest-keypair-253891769',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06966e2f4d3a4dec92282c7ad348635d',ramdisk_id='',reservation_id='r-xn9yuqzt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-303418642',owner_user_name='tempest-AttachVolumeNegativeTest-303418642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d405421ceb4d99967ef2e7f55e7809',uuid=bed4001c-02c2-4c6b-84c8-61654df66d8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b644e09b-afb0-43e7-9773-0df435010320", "address": "fa:16:3e:16:ad:8e", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb644e09b-af", "ovs_interfaceid": "b644e09b-afb0-43e7-9773-0df435010320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converting VIF {"id": "b644e09b-afb0-43e7-9773-0df435010320", "address": "fa:16:3e:16:ad:8e", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb644e09b-af", "ovs_interfaceid": "b644e09b-afb0-43e7-9773-0df435010320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ad:8e,bridge_name='br-int',has_traffic_filtering=True,id=b644e09b-afb0-43e7-9773-0df435010320,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb644e09b-af') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.objects.instance [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'pci_devices' on Instance uuid bed4001c-02c2-4c6b-84c8-61654df66d8b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:21:53 user nova-compute[82196]:   <uuid>bed4001c-02c2-4c6b-84c8-61654df66d8b</uuid>
Apr 11 19:21:53 user nova-compute[82196]:   <name>instance-00000003</name>
Apr 11 19:21:53 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:21:53 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:21:53 user nova-compute[82196]:   <metadata>
Apr 11 19:21:53 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:21:53 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:21:53 user nova-compute[82196]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1923045055</nova:name>
Apr 11 19:21:53 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:21:53</nova:creationTime>
Apr 11 19:21:53 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:21:53 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:21:53 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:21:53 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:21:53 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:21:53 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:21:53 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:21:53 user nova-compute[82196]:       <nova:owner>
Apr 11 19:21:53 user nova-compute[82196]:         <nova:user uuid="d5d405421ceb4d99967ef2e7f55e7809">tempest-AttachVolumeNegativeTest-303418642-project-member</nova:user>
Apr 11 19:21:53 user nova-compute[82196]:         <nova:project uuid="06966e2f4d3a4dec92282c7ad348635d">tempest-AttachVolumeNegativeTest-303418642</nova:project>
Apr 11 19:21:53 user nova-compute[82196]:       </nova:owner>
Apr 11 19:21:53 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:21:53 user nova-compute[82196]:       <nova:ports>
Apr 11 19:21:53 user nova-compute[82196]:         <nova:port uuid="b644e09b-afb0-43e7-9773-0df435010320">
Apr 11 19:21:53 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 19:21:53 user nova-compute[82196]:         </nova:port>
Apr 11 19:21:53 user nova-compute[82196]:       </nova:ports>
Apr 11 19:21:53 user nova-compute[82196]:     </nova:instance>
Apr 11 19:21:53 user nova-compute[82196]:   </metadata>
Apr 11 19:21:53 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:21:53 user nova-compute[82196]:     <system>
Apr 11 19:21:53 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:21:53 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:21:53 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:21:53 user nova-compute[82196]:       <entry name="serial">bed4001c-02c2-4c6b-84c8-61654df66d8b</entry>
Apr 11 19:21:53 user nova-compute[82196]:       <entry name="uuid">bed4001c-02c2-4c6b-84c8-61654df66d8b</entry>
Apr 11 19:21:53 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:21:53 user nova-compute[82196]:     </system>
Apr 11 19:21:53 user nova-compute[82196]:   </sysinfo>
Apr 11 19:21:53 user nova-compute[82196]:   <os>
Apr 11 19:21:53 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:21:53 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:21:53 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:21:53 user nova-compute[82196]:   </os>
Apr 11 19:21:53 user nova-compute[82196]:   <features>
Apr 11 19:21:53 user nova-compute[82196]:     <acpi/>
Apr 11 19:21:53 user nova-compute[82196]:     <apic/>
Apr 11 19:21:53 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:21:53 user nova-compute[82196]:   </features>
Apr 11 19:21:53 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:21:53 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:21:53 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:21:53 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:21:53 user nova-compute[82196]:   </clock>
Apr 11 19:21:53 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:21:53 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:21:53 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:21:53 user nova-compute[82196]:   </cpu>
Apr 11 19:21:53 user nova-compute[82196]:   <devices>
Apr 11 19:21:53 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:21:53 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:21:53 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk"/>
Apr 11 19:21:53 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:21:53 user nova-compute[82196]:     </disk>
Apr 11 19:21:53 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:21:53 user nova-compute[82196]:       <mac address="fa:16:3e:16:ad:8e"/>
Apr 11 19:21:53 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:21:53 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:21:53 user nova-compute[82196]:       <target dev="tapb644e09b-af"/>
Apr 11 19:21:53 user nova-compute[82196]:     </interface>
Apr 11 19:21:53 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:21:53 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/console.log" append="off"/>
Apr 11 19:21:53 user nova-compute[82196]:     </serial>
Apr 11 19:21:53 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:21:53 user nova-compute[82196]:     <video>
Apr 11 19:21:53 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:21:53 user nova-compute[82196]:     </video>
Apr 11 19:21:53 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:21:53 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:21:53 user nova-compute[82196]:     </rng>
Apr 11 19:21:53 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:21:53 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:21:53 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:21:53 user nova-compute[82196]:     </memballoon>
Apr 11 19:21:53 user nova-compute[82196]:   </devices>
Apr 11 19:21:53 user nova-compute[82196]: </domain>
Apr 11 19:21:53 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1923045055',display_name='tempest-AttachVolumeNegativeTest-server-1923045055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1923045055',id=3,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXl985Dnl44xCHtf4FIl1xYVxoZaplMJQzbwa3Y9N5KsJvliQVBgK4OaT/SgpGEh9Q8h4HPARqY2MPNwKL+8Ropi74fbtw+x6EYUP9DMyAquimJy9wP/Ns3xiePmd0rew==',key_name='tempest-keypair-253891769',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06966e2f4d3a4dec92282c7ad348635d',ramdisk_id='',reservation_id='r-xn9yuqzt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-303418642',owner_user_name='tempest-AttachVolumeNegativeTest-303418642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d405421ceb4d99967ef2e7f55e7809',uuid=bed4001c-02c2-4c6b-84c8-61654df66d8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b644e09b-afb0-43e7-9773-0df435010320", "address": "fa:16:3e:16:ad:8e", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb644e09b-af", "ovs_interfaceid": "b644e09b-afb0-43e7-9773-0df435010320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converting VIF {"id": "b644e09b-afb0-43e7-9773-0df435010320", "address": "fa:16:3e:16:ad:8e", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb644e09b-af", "ovs_interfaceid": "b644e09b-afb0-43e7-9773-0df435010320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ad:8e,bridge_name='br-int',has_traffic_filtering=True,id=b644e09b-afb0-43e7-9773-0df435010320,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb644e09b-af') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG os_vif [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ad:8e,bridge_name='br-int',has_traffic_filtering=True,id=b644e09b-afb0-43e7-9773-0df435010320,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb644e09b-af') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb644e09b-af, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb644e09b-af, col_values=(('external_ids', {'iface-id': 'b644e09b-afb0-43e7-9773-0df435010320', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:ad:8e', 'vm-uuid': 'bed4001c-02c2-4c6b-84c8-61654df66d8b'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:53 user nova-compute[82196]: INFO os_vif [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ad:8e,bridge_name='br-int',has_traffic_filtering=True,id=b644e09b-afb0-43e7-9773-0df435010320,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb644e09b-af')
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240913.6163847, efd7afec-d6d0-4e3f-a3b9-f672b3e711cf => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:21:53 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] VM Resumed (Lifecycle Event)
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:21:53 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Instance spawned successfully.
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No VIF found with MAC fa:16:3e:16:ad:8e, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:21:53 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Instance spawned successfully.
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:53 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240913.6273618, efd7afec-d6d0-4e3f-a3b9-f672b3e711cf => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:21:53 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] VM Started (Lifecycle Event)
Apr 11 19:21:53 user nova-compute[82196]: INFO nova.compute.manager [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Took 14.34 seconds to spawn the instance on the hypervisor.
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:21:53 user nova-compute[82196]: INFO nova.compute.manager [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Took 14.90 seconds to spawn the instance on the hypervisor.
Apr 11 19:21:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:21:54 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:21:54 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240913.7327018, fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:21:54 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] VM Resumed (Lifecycle Event)
Apr 11 19:21:54 user nova-compute[82196]: INFO nova.compute.manager [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Took 15.77 seconds to build instance.
Apr 11 19:21:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:21:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d06eb8ff-850f-4684-b564-520d2f591a4e tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.899s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:21:54 user nova-compute[82196]: INFO nova.compute.manager [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Took 16.01 seconds to build instance.
Apr 11 19:21:54 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240913.734401, fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:21:54 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] VM Started (Lifecycle Event)
Apr 11 19:21:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-136dddbd-b4d6-4dd9-8c56-1b7c17a4a726 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.245s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:21:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:21:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-f07a72fb-56e4-402e-8957-a7d4dd8feed5 req-00c6428f-1237-48ac-8a1b-c82de30bcdf4 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Received event network-vif-plugged-096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:21:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f07a72fb-56e4-402e-8957-a7d4dd8feed5 req-00c6428f-1237-48ac-8a1b-c82de30bcdf4 service nova] Acquiring lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f07a72fb-56e4-402e-8957-a7d4dd8feed5 req-00c6428f-1237-48ac-8a1b-c82de30bcdf4 service nova] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f07a72fb-56e4-402e-8957-a7d4dd8feed5 req-00c6428f-1237-48ac-8a1b-c82de30bcdf4 service nova] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-f07a72fb-56e4-402e-8957-a7d4dd8feed5 req-00c6428f-1237-48ac-8a1b-c82de30bcdf4 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] No waiting events found dispatching network-vif-plugged-096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:21:54 user nova-compute[82196]: WARNING nova.compute.manager [req-f07a72fb-56e4-402e-8957-a7d4dd8feed5 req-00c6428f-1237-48ac-8a1b-c82de30bcdf4 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Received unexpected event network-vif-plugged-096d6451-049b-4ff5-9eaf-8ee3884c8715 for instance with vm_state active and task_state None.
Apr 11 19:21:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Received event network-changed-b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:21:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Refreshing instance network info cache due to event network-changed-b644e09b-afb0-43e7-9773-0df435010320. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:21:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] Acquiring lock "refresh_cache-bed4001c-02c2-4c6b-84c8-61654df66d8b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:21:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] Acquired lock "refresh_cache-bed4001c-02c2-4c6b-84c8-61654df66d8b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:21:55 user nova-compute[82196]: DEBUG nova.network.neutron [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Refreshing network info cache for port b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:21:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:56 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Successfully created port: 5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:21:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:56 user nova-compute[82196]: DEBUG nova.network.neutron [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Updated VIF entry in instance network info cache for port b644e09b-afb0-43e7-9773-0df435010320. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:21:56 user nova-compute[82196]: DEBUG nova.network.neutron [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Updating instance_info_cache with network_info: [{"id": "b644e09b-afb0-43e7-9773-0df435010320", "address": "fa:16:3e:16:ad:8e", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb644e09b-af", "ovs_interfaceid": "b644e09b-afb0-43e7-9773-0df435010320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:21:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] Releasing lock "refresh_cache-bed4001c-02c2-4c6b-84c8-61654df66d8b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:21:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Received event network-vif-plugged-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:21:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] Acquiring lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] No waiting events found dispatching network-vif-plugged-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:21:56 user nova-compute[82196]: WARNING nova.compute.manager [req-24eff254-cf1c-4ad1-b1cb-027bb99ce5ad req-4acaf707-e485-43e9-9abb-9ac08761f5eb service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Received unexpected event network-vif-plugged-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d for instance with vm_state active and task_state None.
Apr 11 19:21:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-3a32bf8e-96c8-450e-902a-67ca3cf4a385 req-e9a3a4e5-21ee-4a8d-ad7a-5ff39706088f service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Received event network-vif-plugged-b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:21:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3a32bf8e-96c8-450e-902a-67ca3cf4a385 req-e9a3a4e5-21ee-4a8d-ad7a-5ff39706088f service nova] Acquiring lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3a32bf8e-96c8-450e-902a-67ca3cf4a385 req-e9a3a4e5-21ee-4a8d-ad7a-5ff39706088f service nova] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3a32bf8e-96c8-450e-902a-67ca3cf4a385 req-e9a3a4e5-21ee-4a8d-ad7a-5ff39706088f service nova] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-3a32bf8e-96c8-450e-902a-67ca3cf4a385 req-e9a3a4e5-21ee-4a8d-ad7a-5ff39706088f service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] No waiting events found dispatching network-vif-plugged-b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:21:57 user nova-compute[82196]: WARNING nova.compute.manager [req-3a32bf8e-96c8-450e-902a-67ca3cf4a385 req-e9a3a4e5-21ee-4a8d-ad7a-5ff39706088f service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Received unexpected event network-vif-plugged-b644e09b-afb0-43e7-9773-0df435010320 for instance with vm_state building and task_state spawning.
Apr 11 19:21:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240918.3422482, bed4001c-02c2-4c6b-84c8-61654df66d8b => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:21:58 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] VM Resumed (Lifecycle Event)
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:21:58 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Instance spawned successfully.
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:21:58 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240918.348662, bed4001c-02c2-4c6b-84c8-61654df66d8b => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:21:58 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] VM Started (Lifecycle Event)
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:21:58 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:21:58 user nova-compute[82196]: INFO nova.compute.manager [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Took 12.33 seconds to spawn the instance on the hypervisor.
Apr 11 19:21:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:58 user nova-compute[82196]: INFO nova.compute.manager [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Took 13.21 seconds to build instance.
Apr 11 19:21:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bbc89398-7374-4b1a-b672-54ffb81c26f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.389s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:21:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-9f5fe43a-bd79-4673-b3e5-88982b9722c4 req-ed78d362-51b6-489d-9d8c-03c69bb83ce8 service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Received event network-vif-plugged-b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:21:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9f5fe43a-bd79-4673-b3e5-88982b9722c4 req-ed78d362-51b6-489d-9d8c-03c69bb83ce8 service nova] Acquiring lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:21:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9f5fe43a-bd79-4673-b3e5-88982b9722c4 req-ed78d362-51b6-489d-9d8c-03c69bb83ce8 service nova] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:21:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9f5fe43a-bd79-4673-b3e5-88982b9722c4 req-ed78d362-51b6-489d-9d8c-03c69bb83ce8 service nova] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:21:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-9f5fe43a-bd79-4673-b3e5-88982b9722c4 req-ed78d362-51b6-489d-9d8c-03c69bb83ce8 service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] No waiting events found dispatching network-vif-plugged-b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:21:59 user nova-compute[82196]: WARNING nova.compute.manager [req-9f5fe43a-bd79-4673-b3e5-88982b9722c4 req-ed78d362-51b6-489d-9d8c-03c69bb83ce8 service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Received unexpected event network-vif-plugged-b644e09b-afb0-43e7-9773-0df435010320 for instance with vm_state active and task_state None.
Apr 11 19:22:00 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Successfully updated port: 5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquired lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:00 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:22:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-changed-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Refreshing instance network info cache due to event network-changed-5a15e207-1839-4be5-80b2-fc995098dbbf. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] Acquiring lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:00 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updating instance_info_cache with network_info: [{"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Releasing lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Instance network_info: |[{"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] Acquired lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.network.neutron [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Refreshing network info cache for port 5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Start _get_guest_xml network_info=[{"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:22:02 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:02 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-309951304',display_name='tempest-ServerStableDeviceRescueTest-server-309951304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-309951304',id=4,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQPHRAJfFRFeAUt5MqGdWAF2Vw2uFd+0nfpM413xhOuBbSDaV6LfVNTeVPCQwsh3pP3/wPGteAXUcszYrP1qam1IH+EIRD9QQUduJX8PlHQPLpnCt50NfjnO6EpONvQTg==',key_name='tempest-keypair-909036118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11ee7c68b277420ba524c2a99cd444ea',ramdisk_id='',reservation_id='r-hjoe23y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-400855764',owner_user_name='tempest-ServerStableDeviceRescueTest-400855764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:21:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26f091a1508b4d2689005b660f6a1380',uuid=aa0bb9aa-a93d-45bc-9f90-46eeb6416365,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Converting VIF {"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:eb:fe,bridge_name='br-int',has_traffic_filtering=True,id=5a15e207-1839-4be5-80b2-fc995098dbbf,network=Network(e637d15d-90c0-48cc-8229-ffd26c0be8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a15e207-18') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'pci_devices' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:22:02 user nova-compute[82196]:   <uuid>aa0bb9aa-a93d-45bc-9f90-46eeb6416365</uuid>
Apr 11 19:22:02 user nova-compute[82196]:   <name>instance-00000004</name>
Apr 11 19:22:02 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:22:02 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:22:02 user nova-compute[82196]:   <metadata>
Apr 11 19:22:02 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:22:02 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:22:02 user nova-compute[82196]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-309951304</nova:name>
Apr 11 19:22:02 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:22:02</nova:creationTime>
Apr 11 19:22:02 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:22:02 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:22:02 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:22:02 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:22:02 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:22:02 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:22:02 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:22:02 user nova-compute[82196]:       <nova:owner>
Apr 11 19:22:02 user nova-compute[82196]:         <nova:user uuid="26f091a1508b4d2689005b660f6a1380">tempest-ServerStableDeviceRescueTest-400855764-project-member</nova:user>
Apr 11 19:22:02 user nova-compute[82196]:         <nova:project uuid="11ee7c68b277420ba524c2a99cd444ea">tempest-ServerStableDeviceRescueTest-400855764</nova:project>
Apr 11 19:22:02 user nova-compute[82196]:       </nova:owner>
Apr 11 19:22:02 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:22:02 user nova-compute[82196]:       <nova:ports>
Apr 11 19:22:02 user nova-compute[82196]:         <nova:port uuid="5a15e207-1839-4be5-80b2-fc995098dbbf">
Apr 11 19:22:02 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 19:22:02 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:02 user nova-compute[82196]:       </nova:ports>
Apr 11 19:22:02 user nova-compute[82196]:     </nova:instance>
Apr 11 19:22:02 user nova-compute[82196]:   </metadata>
Apr 11 19:22:02 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:22:02 user nova-compute[82196]:     <system>
Apr 11 19:22:02 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:22:02 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:22:02 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:22:02 user nova-compute[82196]:       <entry name="serial">aa0bb9aa-a93d-45bc-9f90-46eeb6416365</entry>
Apr 11 19:22:02 user nova-compute[82196]:       <entry name="uuid">aa0bb9aa-a93d-45bc-9f90-46eeb6416365</entry>
Apr 11 19:22:02 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:22:02 user nova-compute[82196]:     </system>
Apr 11 19:22:02 user nova-compute[82196]:   </sysinfo>
Apr 11 19:22:02 user nova-compute[82196]:   <os>
Apr 11 19:22:02 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:22:02 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:22:02 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:22:02 user nova-compute[82196]:   </os>
Apr 11 19:22:02 user nova-compute[82196]:   <features>
Apr 11 19:22:02 user nova-compute[82196]:     <acpi/>
Apr 11 19:22:02 user nova-compute[82196]:     <apic/>
Apr 11 19:22:02 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:22:02 user nova-compute[82196]:   </features>
Apr 11 19:22:02 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:22:02 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:22:02 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:22:02 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:22:02 user nova-compute[82196]:   </clock>
Apr 11 19:22:02 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:22:02 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:22:02 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:22:02 user nova-compute[82196]:   </cpu>
Apr 11 19:22:02 user nova-compute[82196]:   <devices>
Apr 11 19:22:02 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:22:02 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:22:02 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk"/>
Apr 11 19:22:02 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:22:02 user nova-compute[82196]:     </disk>
Apr 11 19:22:02 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:02 user nova-compute[82196]:       <mac address="fa:16:3e:eb:eb:fe"/>
Apr 11 19:22:02 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:02 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:02 user nova-compute[82196]:       <target dev="tap5a15e207-18"/>
Apr 11 19:22:02 user nova-compute[82196]:     </interface>
Apr 11 19:22:02 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:22:02 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/console.log" append="off"/>
Apr 11 19:22:02 user nova-compute[82196]:     </serial>
Apr 11 19:22:02 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:22:02 user nova-compute[82196]:     <video>
Apr 11 19:22:02 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:02 user nova-compute[82196]:     </video>
Apr 11 19:22:02 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:22:02 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:22:02 user nova-compute[82196]:     </rng>
Apr 11 19:22:02 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:22:02 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:22:02 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:22:02 user nova-compute[82196]:     </memballoon>
Apr 11 19:22:02 user nova-compute[82196]:   </devices>
Apr 11 19:22:02 user nova-compute[82196]: </domain>
Apr 11 19:22:02 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-309951304',display_name='tempest-ServerStableDeviceRescueTest-server-309951304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-309951304',id=4,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQPHRAJfFRFeAUt5MqGdWAF2Vw2uFd+0nfpM413xhOuBbSDaV6LfVNTeVPCQwsh3pP3/wPGteAXUcszYrP1qam1IH+EIRD9QQUduJX8PlHQPLpnCt50NfjnO6EpONvQTg==',key_name='tempest-keypair-909036118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11ee7c68b277420ba524c2a99cd444ea',ramdisk_id='',reservation_id='r-hjoe23y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-400855764',owner_user_name='tempest-ServerStableDeviceRescueTest-400855764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:21:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26f091a1508b4d2689005b660f6a1380',uuid=aa0bb9aa-a93d-45bc-9f90-46eeb6416365,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Converting VIF {"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:eb:fe,bridge_name='br-int',has_traffic_filtering=True,id=5a15e207-1839-4be5-80b2-fc995098dbbf,network=Network(e637d15d-90c0-48cc-8229-ffd26c0be8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a15e207-18') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG os_vif [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:eb:fe,bridge_name='br-int',has_traffic_filtering=True,id=5a15e207-1839-4be5-80b2-fc995098dbbf,network=Network(e637d15d-90c0-48cc-8229-ffd26c0be8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a15e207-18') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a15e207-18, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a15e207-18, col_values=(('external_ids', {'iface-id': '5a15e207-1839-4be5-80b2-fc995098dbbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:eb:fe', 'vm-uuid': 'aa0bb9aa-a93d-45bc-9f90-46eeb6416365'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:02 user nova-compute[82196]: INFO os_vif [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:eb:fe,bridge_name='br-int',has_traffic_filtering=True,id=5a15e207-1839-4be5-80b2-fc995098dbbf,network=Network(e637d15d-90c0-48cc-8229-ffd26c0be8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a15e207-18')
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] No VIF found with MAC fa:16:3e:eb:eb:fe, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:22:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:05 user nova-compute[82196]: DEBUG nova.network.neutron [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updated VIF entry in instance network info cache for port 5a15e207-1839-4be5-80b2-fc995098dbbf. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:22:05 user nova-compute[82196]: DEBUG nova.network.neutron [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updating instance_info_cache with network_info: [{"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-bf10d6eb-ca72-4a67-85e8-99e70e5d3f19 req-bb60d0a3-4764-4c42-924d-c0294df897a3 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf10d6eb-ca72-4a67-85e8-99e70e5d3f19 req-bb60d0a3-4764-4c42-924d-c0294df897a3 service nova] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf10d6eb-ca72-4a67-85e8-99e70e5d3f19 req-bb60d0a3-4764-4c42-924d-c0294df897a3 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf10d6eb-ca72-4a67-85e8-99e70e5d3f19 req-bb60d0a3-4764-4c42-924d-c0294df897a3 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-bf10d6eb-ca72-4a67-85e8-99e70e5d3f19 req-bb60d0a3-4764-4c42-924d-c0294df897a3 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] No waiting events found dispatching network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:05 user nova-compute[82196]: WARNING nova.compute.manager [req-bf10d6eb-ca72-4a67-85e8-99e70e5d3f19 req-bb60d0a3-4764-4c42-924d-c0294df897a3 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received unexpected event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf for instance with vm_state building and task_state spawning.
Apr 11 19:22:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5397c6be-900e-4af2-99e4-92ace345a422 req-71b1e2f6-0588-4bf6-9391-94ab63b9611c service nova] Releasing lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.compute.manager [req-7630ec0e-cee4-4ad2-b689-3a0816e70f34 req-f28cb49a-c36a-4329-93ee-eb0febf99a53 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7630ec0e-cee4-4ad2-b689-3a0816e70f34 req-f28cb49a-c36a-4329-93ee-eb0febf99a53 service nova] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7630ec0e-cee4-4ad2-b689-3a0816e70f34 req-f28cb49a-c36a-4329-93ee-eb0febf99a53 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7630ec0e-cee4-4ad2-b689-3a0816e70f34 req-f28cb49a-c36a-4329-93ee-eb0febf99a53 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.compute.manager [req-7630ec0e-cee4-4ad2-b689-3a0816e70f34 req-f28cb49a-c36a-4329-93ee-eb0febf99a53 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] No waiting events found dispatching network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:07 user nova-compute[82196]: WARNING nova.compute.manager [req-7630ec0e-cee4-4ad2-b689-3a0816e70f34 req-f28cb49a-c36a-4329-93ee-eb0febf99a53 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received unexpected event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf for instance with vm_state building and task_state spawning.
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240927.3974965, aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:07 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] VM Resumed (Lifecycle Event)
Apr 11 19:22:07 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Instance spawned successfully.
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:07 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240927.3976958, aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:07 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] VM Started (Lifecycle Event)
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:07 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:07 user nova-compute[82196]: INFO nova.compute.manager [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Took 15.38 seconds to spawn the instance on the hypervisor.
Apr 11 19:22:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:07 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:07 user nova-compute[82196]: INFO nova.compute.manager [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Took 16.29 seconds to build instance.
Apr 11 19:22:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ebce8406-fb4b-495c-8077-9faa681c5912 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.455s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "1ded3918-3bae-465c-a53c-e88011914c50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "1ded3918-3bae-465c-a53c-e88011914c50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:22:14 user nova-compute[82196]: INFO nova.compute.claims [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Claim successful on node user
Apr 11 19:22:14 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:22:14 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 11 19:22:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:22:14 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Creating image(s)
Apr 11 19:22:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "/opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "/opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "f2fe166eb4d8938082cd18d3fbb77b236278e4fd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "f2fe166eb4d8938082cd18d3fbb77b236278e4fd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a49d379e-3976-4d68-b6df-f572a922107c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a49d379e-3976-4d68-b6df-f572a922107c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd.part --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG nova.policy [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26555f273c374f9ba0ed151d2f1cbaef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c6f64ecc104480a149bcfd0610dfef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd.part --force-share --output=json" returned: 0 in 0.163s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG nova.virt.images [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 8ddd1597-acbd-47c5-9492-af80f88fdca1 was qcow2, converting to raw {{(pid=82196) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd.part /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd.converted {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:22:15 user nova-compute[82196]: INFO nova.compute.claims [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Claim successful on node user
Apr 11 19:22:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd.part /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd.converted" returned: 0 in 0.280s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd.converted --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "f2fe166eb4d8938082cd18d3fbb77b236278e4fd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.958s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd --force-share --output=json" returned: 0 in 0.184s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "f2fe166eb4d8938082cd18d3fbb77b236278e4fd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "f2fe166eb4d8938082cd18d3fbb77b236278e4fd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.729s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd --force-share --output=json" returned: 0 in 0.203s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd,backing_fmt=raw /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "9941d033-15c2-4069-b9a6-f80840e95a38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "9941d033-15c2-4069-b9a6-f80840e95a38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd,backing_fmt=raw /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk 1073741824" returned: 0 in 0.093s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "f2fe166eb4d8938082cd18d3fbb77b236278e4fd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:22:16 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:22:16 user nova-compute[82196]: INFO nova.compute.claims [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Claim successful on node user
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd --force-share --output=json" returned: 0 in 0.203s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.policy [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24e95f55f8f9497592320a19f2ca7fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f8ee2edca748e0bd03ace6f93be649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:22:16 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Creating image(s)
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "/opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "/opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "/opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Cannot resize image /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lazy-loading 'migration_context' on Instance uuid 1ded3918-3bae-465c-a53c-e88011914c50 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Ensure instance console log exists: /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.171s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk 1073741824" returned: 0 in 0.078s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.169s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.748s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Cannot resize image /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lazy-loading 'migration_context' on Instance uuid a49d379e-3976-4d68-b6df-f572a922107c {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:17 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Ensure instance console log exists: /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:22:17 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Creating image(s)
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "/opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "/opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "/opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Successfully created port: 936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.163s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Successfully created port: 8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG nova.policy [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54b4a383f04d4269a0099a738e14807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f153e6b272924b8fa0ef28fb5f0970bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.168s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk 1073741824" returned: 0 in 0.072s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.175s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Cannot resize image /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG nova.objects.instance [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lazy-loading 'migration_context' on Instance uuid 9941d033-15c2-4069-b9a6-f80840e95a38 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Ensure instance console log exists: /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Successfully updated port: 936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "refresh_cache-a49d379e-3976-4d68-b6df-f572a922107c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquired lock "refresh_cache-a49d379e-3976-4d68-b6df-f572a922107c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG nova.compute.manager [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Received event network-changed-936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG nova.compute.manager [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Refreshing instance network info cache due to event network-changed-936e8263-dbb3-4e76-8f6d-0e3269dc6066. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] Acquiring lock "refresh_cache-a49d379e-3976-4d68-b6df-f572a922107c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Successfully created port: 031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "b71d95ed-728d-4386-b7c6-50b252718ca9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Updating instance_info_cache with network_info: [{"id": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "address": "fa:16:3e:bf:52:8c", "network": {"id": "f46874c2-3c80-4650-be3d-22d674b93195", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1165457224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f8ee2edca748e0bd03ace6f93be649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap936e8263-db", "ovs_interfaceid": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Releasing lock "refresh_cache-a49d379e-3976-4d68-b6df-f572a922107c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Instance network_info: |[{"id": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "address": "fa:16:3e:bf:52:8c", "network": {"id": "f46874c2-3c80-4650-be3d-22d674b93195", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1165457224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f8ee2edca748e0bd03ace6f93be649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap936e8263-db", "ovs_interfaceid": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] Acquired lock "refresh_cache-a49d379e-3976-4d68-b6df-f572a922107c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.network.neutron [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Refreshing network info cache for port 936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Start _get_guest_xml network_info=[{"id": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "address": "fa:16:3e:bf:52:8c", "network": {"id": "f46874c2-3c80-4650-be3d-22d674b93195", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1165457224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f8ee2edca748e0bd03ace6f93be649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap936e8263-db", "ovs_interfaceid": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:22:19 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:19 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1592033128',display_name='tempest-TestVolumeSwap-server-1592033128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1592033128',id=6,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAzMdMSQLLiV3JpjVwmLTTmwbzkoJeV6SA3UR8oDreyp/7jf42SjayBVPZUVEXJCuPvBauTtzXHflWxGcTjSNelxaY2xGUn/tnq1c/9lLP/bJj0WIjeFFfa+9CmZIz9FA==',key_name='tempest-keypair-1479395347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9f8ee2edca748e0bd03ace6f93be649',ramdisk_id='',reservation_id='r-udaehb89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1558953300',owner_user_name='tempest-TestVolumeSwap-1558953300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24e95f55f8f9497592320a19f2ca7fb8',uuid=a49d379e-3976-4d68-b6df-f572a922107c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "address": "fa:16:3e:bf:52:8c", "network": {"id": "f46874c2-3c80-4650-be3d-22d674b93195", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1165457224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f8ee2edca748e0bd03ace6f93be649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap936e8263-db", "ovs_interfaceid": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Converting VIF {"id": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "address": "fa:16:3e:bf:52:8c", "network": {"id": "f46874c2-3c80-4650-be3d-22d674b93195", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1165457224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f8ee2edca748e0bd03ace6f93be649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap936e8263-db", "ovs_interfaceid": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=936e8263-dbb3-4e76-8f6d-0e3269dc6066,network=Network(f46874c2-3c80-4650-be3d-22d674b93195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap936e8263-db') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lazy-loading 'pci_devices' on Instance uuid a49d379e-3976-4d68-b6df-f572a922107c {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:22:19 user nova-compute[82196]: INFO nova.compute.claims [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Claim successful on node user
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:22:19 user nova-compute[82196]:   <uuid>a49d379e-3976-4d68-b6df-f572a922107c</uuid>
Apr 11 19:22:19 user nova-compute[82196]:   <name>instance-00000006</name>
Apr 11 19:22:19 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:22:19 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:22:19 user nova-compute[82196]:   <metadata>
Apr 11 19:22:19 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:22:19 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:22:19 user nova-compute[82196]:       <nova:name>tempest-TestVolumeSwap-server-1592033128</nova:name>
Apr 11 19:22:19 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:22:19</nova:creationTime>
Apr 11 19:22:19 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:22:19 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:22:19 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:22:19 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:22:19 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:22:19 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:22:19 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:22:19 user nova-compute[82196]:       <nova:owner>
Apr 11 19:22:19 user nova-compute[82196]:         <nova:user uuid="24e95f55f8f9497592320a19f2ca7fb8">tempest-TestVolumeSwap-1558953300-project-member</nova:user>
Apr 11 19:22:19 user nova-compute[82196]:         <nova:project uuid="e9f8ee2edca748e0bd03ace6f93be649">tempest-TestVolumeSwap-1558953300</nova:project>
Apr 11 19:22:19 user nova-compute[82196]:       </nova:owner>
Apr 11 19:22:19 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:22:19 user nova-compute[82196]:       <nova:ports>
Apr 11 19:22:19 user nova-compute[82196]:         <nova:port uuid="936e8263-dbb3-4e76-8f6d-0e3269dc6066">
Apr 11 19:22:19 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 19:22:19 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:19 user nova-compute[82196]:       </nova:ports>
Apr 11 19:22:19 user nova-compute[82196]:     </nova:instance>
Apr 11 19:22:19 user nova-compute[82196]:   </metadata>
Apr 11 19:22:19 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:22:19 user nova-compute[82196]:     <system>
Apr 11 19:22:19 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:22:19 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:22:19 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:22:19 user nova-compute[82196]:       <entry name="serial">a49d379e-3976-4d68-b6df-f572a922107c</entry>
Apr 11 19:22:19 user nova-compute[82196]:       <entry name="uuid">a49d379e-3976-4d68-b6df-f572a922107c</entry>
Apr 11 19:22:19 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:22:19 user nova-compute[82196]:     </system>
Apr 11 19:22:19 user nova-compute[82196]:   </sysinfo>
Apr 11 19:22:19 user nova-compute[82196]:   <os>
Apr 11 19:22:19 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:22:19 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:22:19 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:22:19 user nova-compute[82196]:   </os>
Apr 11 19:22:19 user nova-compute[82196]:   <features>
Apr 11 19:22:19 user nova-compute[82196]:     <acpi/>
Apr 11 19:22:19 user nova-compute[82196]:     <apic/>
Apr 11 19:22:19 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:22:19 user nova-compute[82196]:   </features>
Apr 11 19:22:19 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:22:19 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:22:19 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:22:19 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:22:19 user nova-compute[82196]:   </clock>
Apr 11 19:22:19 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:22:19 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:22:19 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:22:19 user nova-compute[82196]:   </cpu>
Apr 11 19:22:19 user nova-compute[82196]:   <devices>
Apr 11 19:22:19 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:22:19 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:22:19 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk"/>
Apr 11 19:22:19 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:22:19 user nova-compute[82196]:     </disk>
Apr 11 19:22:19 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:19 user nova-compute[82196]:       <mac address="fa:16:3e:bf:52:8c"/>
Apr 11 19:22:19 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:19 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:19 user nova-compute[82196]:       <target dev="tap936e8263-db"/>
Apr 11 19:22:19 user nova-compute[82196]:     </interface>
Apr 11 19:22:19 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:22:19 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/console.log" append="off"/>
Apr 11 19:22:19 user nova-compute[82196]:     </serial>
Apr 11 19:22:19 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:22:19 user nova-compute[82196]:     <video>
Apr 11 19:22:19 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:19 user nova-compute[82196]:     </video>
Apr 11 19:22:19 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:22:19 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:22:19 user nova-compute[82196]:     </rng>
Apr 11 19:22:19 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:22:19 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:22:19 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:22:19 user nova-compute[82196]:     </memballoon>
Apr 11 19:22:19 user nova-compute[82196]:   </devices>
Apr 11 19:22:19 user nova-compute[82196]: </domain>
Apr 11 19:22:19 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1592033128',display_name='tempest-TestVolumeSwap-server-1592033128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1592033128',id=6,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAzMdMSQLLiV3JpjVwmLTTmwbzkoJeV6SA3UR8oDreyp/7jf42SjayBVPZUVEXJCuPvBauTtzXHflWxGcTjSNelxaY2xGUn/tnq1c/9lLP/bJj0WIjeFFfa+9CmZIz9FA==',key_name='tempest-keypair-1479395347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9f8ee2edca748e0bd03ace6f93be649',ramdisk_id='',reservation_id='r-udaehb89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1558953300',owner_user_name='tempest-TestVolumeSwap-1558953300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24e95f55f8f9497592320a19f2ca7fb8',uuid=a49d379e-3976-4d68-b6df-f572a922107c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "address": "fa:16:3e:bf:52:8c", "network": {"id": "f46874c2-3c80-4650-be3d-22d674b93195", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1165457224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f8ee2edca748e0bd03ace6f93be649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap936e8263-db", "ovs_interfaceid": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Converting VIF {"id": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "address": "fa:16:3e:bf:52:8c", "network": {"id": "f46874c2-3c80-4650-be3d-22d674b93195", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1165457224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f8ee2edca748e0bd03ace6f93be649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap936e8263-db", "ovs_interfaceid": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=936e8263-dbb3-4e76-8f6d-0e3269dc6066,network=Network(f46874c2-3c80-4650-be3d-22d674b93195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap936e8263-db') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG os_vif [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=936e8263-dbb3-4e76-8f6d-0e3269dc6066,network=Network(f46874c2-3c80-4650-be3d-22d674b93195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap936e8263-db') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap936e8263-db, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap936e8263-db, col_values=(('external_ids', {'iface-id': '936e8263-dbb3-4e76-8f6d-0e3269dc6066', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:52:8c', 'vm-uuid': 'a49d379e-3976-4d68-b6df-f572a922107c'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:19 user nova-compute[82196]: INFO os_vif [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=936e8263-dbb3-4e76-8f6d-0e3269dc6066,network=Network(f46874c2-3c80-4650-be3d-22d674b93195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap936e8263-db')
Apr 11 19:22:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] No VIF found with MAC fa:16:3e:bf:52:8c, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Successfully updated port: 8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "refresh_cache-1ded3918-3bae-465c-a53c-e88011914c50" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquired lock "refresh_cache-1ded3918-3bae-465c-a53c-e88011914c50" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Received event network-changed-8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Refreshing instance network info cache due to event network-changed-8f590426-373c-4a90-8829-a2ad1a61fcd7. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] Acquiring lock "refresh_cache-1ded3918-3bae-465c-a53c-e88011914c50" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.287s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:22:20 user nova-compute[82196]: INFO nova.compute.claims [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Claim successful on node user
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.network.neutron [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:22:20 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:22:20 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Creating image(s)
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Updating instance_info_cache with network_info: [{"id": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "address": "fa:16:3e:67:5d:8a", "network": {"id": "a4f38bbd-d96e-48df-855f-7eff4d122089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1765637160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c6f64ecc104480a149bcfd0610dfef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f590426-37", "ovs_interfaceid": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.policy [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Releasing lock "refresh_cache-1ded3918-3bae-465c-a53c-e88011914c50" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Instance network_info: |[{"id": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "address": "fa:16:3e:67:5d:8a", "network": {"id": "a4f38bbd-d96e-48df-855f-7eff4d122089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1765637160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c6f64ecc104480a149bcfd0610dfef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f590426-37", "ovs_interfaceid": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] Acquired lock "refresh_cache-1ded3918-3bae-465c-a53c-e88011914c50" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.network.neutron [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Refreshing network info cache for port 8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Start _get_guest_xml network_info=[{"id": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "address": "fa:16:3e:67:5d:8a", "network": {"id": "a4f38bbd-d96e-48df-855f-7eff4d122089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1765637160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c6f64ecc104480a149bcfd0610dfef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f590426-37", "ovs_interfaceid": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:22:03Z,direct_url=<?>,disk_format='qcow2',id=8ddd1597-acbd-47c5-9492-af80f88fdca1,min_disk=0,min_ram=0,name='',owner='552bf2489ee44ea5a2c08a85aa2cdb61',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:22:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_options': None, 'disk_bus': 'scsi', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '8ddd1597-acbd-47c5-9492-af80f88fdca1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.160s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:20 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:20 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:22:03Z,direct_url=<?>,disk_format='qcow2',id=8ddd1597-acbd-47c5-9492-af80f88fdca1,min_disk=0,min_ram=0,name='',owner='552bf2489ee44ea5a2c08a85aa2cdb61',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:22:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1588512874',display_name='tempest-AttachSCSIVolumeTestJSON-server-1588512874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1588512874',id=5,image_ref='8ddd1597-acbd-47c5-9492-af80f88fdca1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENNIAFAXgldDZ23gkfsz1j1aOWnEH0MZh4aSHSnn1OZB1BmGyYdsPQXM8u6LOOszDd5job+4SPRJzI9j1CzY2ryRwaV1faRl+V6jcoViXB4uLPiI16HL/Vfx/IZpK+Nsg==',key_name='tempest-keypair-1434827992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4c6f64ecc104480a149bcfd0610dfef',ramdisk_id='',reservation_id='r-ipzh94nm',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8ddd1597-acbd-47c5-9492-af80f88fdca1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1532830376',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1532830376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26555f273c374f9ba0ed151d2f1cbaef',uuid=1ded3918-3bae-465c-a53c-e88011914c50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "address": "fa:16:3e:67:5d:8a", "network": {"id": "a4f38bbd-d96e-48df-855f-7eff4d122089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1765637160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c6f64ecc104480a149bcfd0610dfef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f590426-37", "ovs_interfaceid": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Converting VIF {"id": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "address": "fa:16:3e:67:5d:8a", "network": {"id": "a4f38bbd-d96e-48df-855f-7eff4d122089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1765637160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c6f64ecc104480a149bcfd0610dfef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f590426-37", "ovs_interfaceid": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:5d:8a,bridge_name='br-int',has_traffic_filtering=True,id=8f590426-373c-4a90-8829-a2ad1a61fcd7,network=Network(a4f38bbd-d96e-48df-855f-7eff4d122089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f590426-37') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ded3918-3bae-465c-a53c-e88011914c50 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:22:21 user nova-compute[82196]:   <uuid>1ded3918-3bae-465c-a53c-e88011914c50</uuid>
Apr 11 19:22:21 user nova-compute[82196]:   <name>instance-00000005</name>
Apr 11 19:22:21 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:22:21 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:22:21 user nova-compute[82196]:   <metadata>
Apr 11 19:22:21 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:22:21 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:22:21 user nova-compute[82196]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1588512874</nova:name>
Apr 11 19:22:21 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:22:20</nova:creationTime>
Apr 11 19:22:21 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:22:21 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:22:21 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:22:21 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:22:21 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:22:21 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:22:21 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:22:21 user nova-compute[82196]:       <nova:owner>
Apr 11 19:22:21 user nova-compute[82196]:         <nova:user uuid="26555f273c374f9ba0ed151d2f1cbaef">tempest-AttachSCSIVolumeTestJSON-1532830376-project-member</nova:user>
Apr 11 19:22:21 user nova-compute[82196]:         <nova:project uuid="f4c6f64ecc104480a149bcfd0610dfef">tempest-AttachSCSIVolumeTestJSON-1532830376</nova:project>
Apr 11 19:22:21 user nova-compute[82196]:       </nova:owner>
Apr 11 19:22:21 user nova-compute[82196]:       <nova:root type="image" uuid="8ddd1597-acbd-47c5-9492-af80f88fdca1"/>
Apr 11 19:22:21 user nova-compute[82196]:       <nova:ports>
Apr 11 19:22:21 user nova-compute[82196]:         <nova:port uuid="8f590426-373c-4a90-8829-a2ad1a61fcd7">
Apr 11 19:22:21 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 19:22:21 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:21 user nova-compute[82196]:       </nova:ports>
Apr 11 19:22:21 user nova-compute[82196]:     </nova:instance>
Apr 11 19:22:21 user nova-compute[82196]:   </metadata>
Apr 11 19:22:21 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:22:21 user nova-compute[82196]:     <system>
Apr 11 19:22:21 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:22:21 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:22:21 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:22:21 user nova-compute[82196]:       <entry name="serial">1ded3918-3bae-465c-a53c-e88011914c50</entry>
Apr 11 19:22:21 user nova-compute[82196]:       <entry name="uuid">1ded3918-3bae-465c-a53c-e88011914c50</entry>
Apr 11 19:22:21 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:22:21 user nova-compute[82196]:     </system>
Apr 11 19:22:21 user nova-compute[82196]:   </sysinfo>
Apr 11 19:22:21 user nova-compute[82196]:   <os>
Apr 11 19:22:21 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:22:21 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:22:21 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:22:21 user nova-compute[82196]:   </os>
Apr 11 19:22:21 user nova-compute[82196]:   <features>
Apr 11 19:22:21 user nova-compute[82196]:     <acpi/>
Apr 11 19:22:21 user nova-compute[82196]:     <apic/>
Apr 11 19:22:21 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:22:21 user nova-compute[82196]:   </features>
Apr 11 19:22:21 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:22:21 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:22:21 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:22:21 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:22:21 user nova-compute[82196]:   </clock>
Apr 11 19:22:21 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:22:21 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:22:21 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:22:21 user nova-compute[82196]:   </cpu>
Apr 11 19:22:21 user nova-compute[82196]:   <devices>
Apr 11 19:22:21 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:22:21 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:22:21 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk"/>
Apr 11 19:22:21 user nova-compute[82196]:       <target dev="sda" bus="scsi"/>
Apr 11 19:22:21 user nova-compute[82196]:       <address type="drive" controller="0" unit="0"/>
Apr 11 19:22:21 user nova-compute[82196]:     </disk>
Apr 11 19:22:21 user nova-compute[82196]:     <disk type="file" device="cdrom">
Apr 11 19:22:21 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 19:22:21 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk.config"/>
Apr 11 19:22:21 user nova-compute[82196]:       <target dev="sdb" bus="scsi"/>
Apr 11 19:22:21 user nova-compute[82196]:       <address type="drive" controller="0" unit="1"/>
Apr 11 19:22:21 user nova-compute[82196]:     </disk>
Apr 11 19:22:21 user nova-compute[82196]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 11 19:22:21 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:21 user nova-compute[82196]:       <mac address="fa:16:3e:67:5d:8a"/>
Apr 11 19:22:21 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:21 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:21 user nova-compute[82196]:       <target dev="tap8f590426-37"/>
Apr 11 19:22:21 user nova-compute[82196]:     </interface>
Apr 11 19:22:21 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:22:21 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/console.log" append="off"/>
Apr 11 19:22:21 user nova-compute[82196]:     </serial>
Apr 11 19:22:21 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:22:21 user nova-compute[82196]:     <video>
Apr 11 19:22:21 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:21 user nova-compute[82196]:     </video>
Apr 11 19:22:21 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:22:21 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:22:21 user nova-compute[82196]:     </rng>
Apr 11 19:22:21 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:22:21 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:22:21 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:22:21 user nova-compute[82196]:     </memballoon>
Apr 11 19:22:21 user nova-compute[82196]:   </devices>
Apr 11 19:22:21 user nova-compute[82196]: </domain>
Apr 11 19:22:21 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1588512874',display_name='tempest-AttachSCSIVolumeTestJSON-server-1588512874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1588512874',id=5,image_ref='8ddd1597-acbd-47c5-9492-af80f88fdca1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENNIAFAXgldDZ23gkfsz1j1aOWnEH0MZh4aSHSnn1OZB1BmGyYdsPQXM8u6LOOszDd5job+4SPRJzI9j1CzY2ryRwaV1faRl+V6jcoViXB4uLPiI16HL/Vfx/IZpK+Nsg==',key_name='tempest-keypair-1434827992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4c6f64ecc104480a149bcfd0610dfef',ramdisk_id='',reservation_id='r-ipzh94nm',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8ddd1597-acbd-47c5-9492-af80f88fdca1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1532830376',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1532830376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26555f273c374f9ba0ed151d2f1cbaef',uuid=1ded3918-3bae-465c-a53c-e88011914c50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "address": "fa:16:3e:67:5d:8a", "network": {"id": "a4f38bbd-d96e-48df-855f-7eff4d122089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1765637160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c6f64ecc104480a149bcfd0610dfef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f590426-37", "ovs_interfaceid": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Converting VIF {"id": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "address": "fa:16:3e:67:5d:8a", "network": {"id": "a4f38bbd-d96e-48df-855f-7eff4d122089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1765637160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c6f64ecc104480a149bcfd0610dfef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f590426-37", "ovs_interfaceid": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:5d:8a,bridge_name='br-int',has_traffic_filtering=True,id=8f590426-373c-4a90-8829-a2ad1a61fcd7,network=Network(a4f38bbd-d96e-48df-855f-7eff4d122089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f590426-37') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG os_vif [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:5d:8a,bridge_name='br-int',has_traffic_filtering=True,id=8f590426-373c-4a90-8829-a2ad1a61fcd7,network=Network(a4f38bbd-d96e-48df-855f-7eff4d122089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f590426-37') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.297s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f590426-37, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f590426-37, col_values=(('external_ids', {'iface-id': '8f590426-373c-4a90-8829-a2ad1a61fcd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:5d:8a', 'vm-uuid': '1ded3918-3bae-465c-a53c-e88011914c50'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk 1073741824" returned: 0 in 0.083s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.389s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.network.neutron [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Updated VIF entry in instance network info cache for port 936e8263-dbb3-4e76-8f6d-0e3269dc6066. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.network.neutron [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Updating instance_info_cache with network_info: [{"id": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "address": "fa:16:3e:bf:52:8c", "network": {"id": "f46874c2-3c80-4650-be3d-22d674b93195", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1165457224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f8ee2edca748e0bd03ace6f93be649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap936e8263-db", "ovs_interfaceid": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:21 user nova-compute[82196]: INFO os_vif [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:5d:8a,bridge_name='br-int',has_traffic_filtering=True,id=8f590426-373c-4a90-8829-a2ad1a61fcd7,network=Network(a4f38bbd-d96e-48df-855f-7eff4d122089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f590426-37')
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3a52202f-e96b-4254-8645-5265f33f3953 req-f395341e-b9d3-4e74-ab35-fe52b3189d6e service nova] Releasing lock "refresh_cache-a49d379e-3976-4d68-b6df-f572a922107c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.183s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Successfully updated port: 031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.079s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "refresh_cache-9941d033-15c2-4069-b9a6-f80840e95a38" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquired lock "refresh_cache-9941d033-15c2-4069-b9a6-f80840e95a38" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Received event network-changed-031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Refreshing instance network info cache due to event network-changed-031df3cc-5433-459d-ab9b-484629289e90. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] Acquiring lock "refresh_cache-9941d033-15c2-4069-b9a6-f80840e95a38" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] No BDM found with device name sda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] No VIF found with MAC fa:16:3e:67:5d:8a, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:22:21 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Using config drive
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:22:21 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:22:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Cannot resize image /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.objects.instance [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lazy-loading 'migration_context' on Instance uuid b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Ensure instance console log exists: /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.network.neutron [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Updated VIF entry in instance network info cache for port 8f590426-373c-4a90-8829-a2ad1a61fcd7. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:22:21 user nova-compute[82196]: DEBUG nova.network.neutron [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Updating instance_info_cache with network_info: [{"id": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "address": "fa:16:3e:67:5d:8a", "network": {"id": "a4f38bbd-d96e-48df-855f-7eff4d122089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1765637160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c6f64ecc104480a149bcfd0610dfef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f590426-37", "ovs_interfaceid": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:21 user nova-compute[82196]: INFO nova.virt.block_device [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Booting with volume a38d7c75-168f-480e-8f42-0c2606086f09 at /dev/vda
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0566eb87-f223-4aba-82fd-807313368960 req-cd559323-57a5-4aea-a86e-963408a8eb2a service nova] Releasing lock "refresh_cache-1ded3918-3bae-465c-a53c-e88011914c50" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:21 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Creating config drive at /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk.config
Apr 11 19:22:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy0dp05hh {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG os_brick.utils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:22:22 user nova-compute[82196]: INFO oslo.privsep.daemon [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp7od3fuea/privsep.sock']
Apr 11 19:22:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy0dp05hh" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:22 user sudo[91897]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp7od3fuea/privsep.sock
Apr 11 19:22:22 user sudo[91897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.policy [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f44f0d0807342ba9b851e7530a82294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa97b49ae647c899a05d54b7f0f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-b521eb3d-a201-4117-b11d-c720e138b16d req-d50e2a66-762f-4a8b-a0ac-6dd6f7515402 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Received event network-vif-plugged-936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b521eb3d-a201-4117-b11d-c720e138b16d req-d50e2a66-762f-4a8b-a0ac-6dd6f7515402 service nova] Acquiring lock "a49d379e-3976-4d68-b6df-f572a922107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b521eb3d-a201-4117-b11d-c720e138b16d req-d50e2a66-762f-4a8b-a0ac-6dd6f7515402 service nova] Lock "a49d379e-3976-4d68-b6df-f572a922107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b521eb3d-a201-4117-b11d-c720e138b16d req-d50e2a66-762f-4a8b-a0ac-6dd6f7515402 service nova] Lock "a49d379e-3976-4d68-b6df-f572a922107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-b521eb3d-a201-4117-b11d-c720e138b16d req-d50e2a66-762f-4a8b-a0ac-6dd6f7515402 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] No waiting events found dispatching network-vif-plugged-936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:22 user nova-compute[82196]: WARNING nova.compute.manager [req-b521eb3d-a201-4117-b11d-c720e138b16d req-d50e2a66-762f-4a8b-a0ac-6dd6f7515402 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Received unexpected event network-vif-plugged-936e8263-dbb3-4e76-8f6d-0e3269dc6066 for instance with vm_state building and task_state spawning.
Apr 11 19:22:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Updating instance_info_cache with network_info: [{"id": "031df3cc-5433-459d-ab9b-484629289e90", "address": "fa:16:3e:b6:4d:98", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031df3cc-54", "ovs_interfaceid": "031df3cc-5433-459d-ab9b-484629289e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Releasing lock "refresh_cache-9941d033-15c2-4069-b9a6-f80840e95a38" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Instance network_info: |[{"id": "031df3cc-5433-459d-ab9b-484629289e90", "address": "fa:16:3e:b6:4d:98", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031df3cc-54", "ovs_interfaceid": "031df3cc-5433-459d-ab9b-484629289e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] Acquired lock "refresh_cache-9941d033-15c2-4069-b9a6-f80840e95a38" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.network.neutron [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Refreshing network info cache for port 031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Start _get_guest_xml network_info=[{"id": "031df3cc-5433-459d-ab9b-484629289e90", "address": "fa:16:3e:b6:4d:98", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031df3cc-54", "ovs_interfaceid": "031df3cc-5433-459d-ab9b-484629289e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:22:22 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:22 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:22:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:22:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-998535947',display_name='tempest-VolumesAdminNegativeTest-server-998535947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-998535947',id=7,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODsmyLx9btIMCYnKduEXVz7JAuk7UhzzERb5FI4FKe+6s/Du4EGpizaOPcFRAe03vOmbzTlXTZKfjibJnH2fbJO2ZanWvJcEb81dDY4qGyrsZxZsx7z4jkiSNbg+OQg3w==',key_name='tempest-keypair-837441637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f153e6b272924b8fa0ef28fb5f0970bb',ramdisk_id='',reservation_id='r-b8rbzc5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1308264816',owner_user_name='tempest-VolumesAdminNegativeTest-1308264816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b4a383f04d4269a0099a738e14807e',uuid=9941d033-15c2-4069-b9a6-f80840e95a38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "031df3cc-5433-459d-ab9b-484629289e90", "address": "fa:16:3e:b6:4d:98", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031df3cc-54", "ovs_interfaceid": "031df3cc-5433-459d-ab9b-484629289e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Converting VIF {"id": "031df3cc-5433-459d-ab9b-484629289e90", "address": "fa:16:3e:b6:4d:98", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031df3cc-54", "ovs_interfaceid": "031df3cc-5433-459d-ab9b-484629289e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:4d:98,bridge_name='br-int',has_traffic_filtering=True,id=031df3cc-5433-459d-ab9b-484629289e90,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031df3cc-54') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG nova.objects.instance [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lazy-loading 'pci_devices' on Instance uuid 9941d033-15c2-4069-b9a6-f80840e95a38 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:22:23 user nova-compute[82196]:   <uuid>9941d033-15c2-4069-b9a6-f80840e95a38</uuid>
Apr 11 19:22:23 user nova-compute[82196]:   <name>instance-00000007</name>
Apr 11 19:22:23 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:22:23 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:22:23 user nova-compute[82196]:   <metadata>
Apr 11 19:22:23 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:22:23 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:22:23 user nova-compute[82196]:       <nova:name>tempest-VolumesAdminNegativeTest-server-998535947</nova:name>
Apr 11 19:22:23 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:22:22</nova:creationTime>
Apr 11 19:22:23 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:22:23 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:22:23 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:22:23 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:22:23 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:22:23 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:22:23 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:22:23 user nova-compute[82196]:       <nova:owner>
Apr 11 19:22:23 user nova-compute[82196]:         <nova:user uuid="54b4a383f04d4269a0099a738e14807e">tempest-VolumesAdminNegativeTest-1308264816-project-member</nova:user>
Apr 11 19:22:23 user nova-compute[82196]:         <nova:project uuid="f153e6b272924b8fa0ef28fb5f0970bb">tempest-VolumesAdminNegativeTest-1308264816</nova:project>
Apr 11 19:22:23 user nova-compute[82196]:       </nova:owner>
Apr 11 19:22:23 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:22:23 user nova-compute[82196]:       <nova:ports>
Apr 11 19:22:23 user nova-compute[82196]:         <nova:port uuid="031df3cc-5433-459d-ab9b-484629289e90">
Apr 11 19:22:23 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 19:22:23 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:23 user nova-compute[82196]:       </nova:ports>
Apr 11 19:22:23 user nova-compute[82196]:     </nova:instance>
Apr 11 19:22:23 user nova-compute[82196]:   </metadata>
Apr 11 19:22:23 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:22:23 user nova-compute[82196]:     <system>
Apr 11 19:22:23 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:22:23 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:22:23 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:22:23 user nova-compute[82196]:       <entry name="serial">9941d033-15c2-4069-b9a6-f80840e95a38</entry>
Apr 11 19:22:23 user nova-compute[82196]:       <entry name="uuid">9941d033-15c2-4069-b9a6-f80840e95a38</entry>
Apr 11 19:22:23 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:22:23 user nova-compute[82196]:     </system>
Apr 11 19:22:23 user nova-compute[82196]:   </sysinfo>
Apr 11 19:22:23 user nova-compute[82196]:   <os>
Apr 11 19:22:23 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:22:23 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:22:23 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:22:23 user nova-compute[82196]:   </os>
Apr 11 19:22:23 user nova-compute[82196]:   <features>
Apr 11 19:22:23 user nova-compute[82196]:     <acpi/>
Apr 11 19:22:23 user nova-compute[82196]:     <apic/>
Apr 11 19:22:23 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:22:23 user nova-compute[82196]:   </features>
Apr 11 19:22:23 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:22:23 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:22:23 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:22:23 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:22:23 user nova-compute[82196]:   </clock>
Apr 11 19:22:23 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:22:23 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:22:23 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:22:23 user nova-compute[82196]:   </cpu>
Apr 11 19:22:23 user nova-compute[82196]:   <devices>
Apr 11 19:22:23 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:22:23 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:22:23 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk"/>
Apr 11 19:22:23 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:22:23 user nova-compute[82196]:     </disk>
Apr 11 19:22:23 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:23 user nova-compute[82196]:       <mac address="fa:16:3e:b6:4d:98"/>
Apr 11 19:22:23 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:23 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:23 user nova-compute[82196]:       <target dev="tap031df3cc-54"/>
Apr 11 19:22:23 user nova-compute[82196]:     </interface>
Apr 11 19:22:23 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:22:23 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/console.log" append="off"/>
Apr 11 19:22:23 user nova-compute[82196]:     </serial>
Apr 11 19:22:23 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:22:23 user nova-compute[82196]:     <video>
Apr 11 19:22:23 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:23 user nova-compute[82196]:     </video>
Apr 11 19:22:23 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:22:23 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:22:23 user nova-compute[82196]:     </rng>
Apr 11 19:22:23 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:22:23 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:22:23 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:22:23 user nova-compute[82196]:     </memballoon>
Apr 11 19:22:23 user nova-compute[82196]:   </devices>
Apr 11 19:22:23 user nova-compute[82196]: </domain>
Apr 11 19:22:23 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:22:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-998535947',display_name='tempest-VolumesAdminNegativeTest-server-998535947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-998535947',id=7,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODsmyLx9btIMCYnKduEXVz7JAuk7UhzzERb5FI4FKe+6s/Du4EGpizaOPcFRAe03vOmbzTlXTZKfjibJnH2fbJO2ZanWvJcEb81dDY4qGyrsZxZsx7z4jkiSNbg+OQg3w==',key_name='tempest-keypair-837441637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f153e6b272924b8fa0ef28fb5f0970bb',ramdisk_id='',reservation_id='r-b8rbzc5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1308264816',owner_user_name='tempest-VolumesAdminNegativeTest-1308264816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b4a383f04d4269a0099a738e14807e',uuid=9941d033-15c2-4069-b9a6-f80840e95a38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "031df3cc-5433-459d-ab9b-484629289e90", "address": "fa:16:3e:b6:4d:98", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031df3cc-54", "ovs_interfaceid": "031df3cc-5433-459d-ab9b-484629289e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Converting VIF {"id": "031df3cc-5433-459d-ab9b-484629289e90", "address": "fa:16:3e:b6:4d:98", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031df3cc-54", "ovs_interfaceid": "031df3cc-5433-459d-ab9b-484629289e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:4d:98,bridge_name='br-int',has_traffic_filtering=True,id=031df3cc-5433-459d-ab9b-484629289e90,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031df3cc-54') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG os_vif [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:4d:98,bridge_name='br-int',has_traffic_filtering=True,id=031df3cc-5433-459d-ab9b-484629289e90,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031df3cc-54') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap031df3cc-54, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap031df3cc-54, col_values=(('external_ids', {'iface-id': '031df3cc-5433-459d-ab9b-484629289e90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:4d:98', 'vm-uuid': '9941d033-15c2-4069-b9a6-f80840e95a38'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG nova.network.neutron [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Successfully created port: 64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:23 user nova-compute[82196]: INFO os_vif [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:4d:98,bridge_name='br-int',has_traffic_filtering=True,id=031df3cc-5433-459d-ab9b-484629289e90,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031df3cc-54')
Apr 11 19:22:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] No VIF found with MAC fa:16:3e:b6:4d:98, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Successfully created port: aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "8e449d09-f632-4f57-b304-430734096596" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "8e449d09-f632-4f57-b304-430734096596" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-9d5eab42-fb9a-48c6-8956-bc15e5cae601 req-39fead22-a956-4490-9faa-e707e658eb79 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Received event network-vif-plugged-936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9d5eab42-fb9a-48c6-8956-bc15e5cae601 req-39fead22-a956-4490-9faa-e707e658eb79 service nova] Acquiring lock "a49d379e-3976-4d68-b6df-f572a922107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9d5eab42-fb9a-48c6-8956-bc15e5cae601 req-39fead22-a956-4490-9faa-e707e658eb79 service nova] Lock "a49d379e-3976-4d68-b6df-f572a922107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9d5eab42-fb9a-48c6-8956-bc15e5cae601 req-39fead22-a956-4490-9faa-e707e658eb79 service nova] Lock "a49d379e-3976-4d68-b6df-f572a922107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-9d5eab42-fb9a-48c6-8956-bc15e5cae601 req-39fead22-a956-4490-9faa-e707e658eb79 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] No waiting events found dispatching network-vif-plugged-936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:24 user nova-compute[82196]: WARNING nova.compute.manager [req-9d5eab42-fb9a-48c6-8956-bc15e5cae601 req-39fead22-a956-4490-9faa-e707e658eb79 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Received unexpected event network-vif-plugged-936e8263-dbb3-4e76-8f6d-0e3269dc6066 for instance with vm_state building and task_state spawning.
Apr 11 19:22:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:22:24 user nova-compute[82196]: INFO nova.compute.claims [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Claim successful on node user
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240944.5018601, a49d379e-3976-4d68-b6df-f572a922107c => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:24 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a49d379e-3976-4d68-b6df-f572a922107c] VM Resumed (Lifecycle Event)
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:22:24 user sudo[91897]: pam_unix(sudo:session): session closed for user root
Apr 11 19:22:24 user nova-compute[82196]: INFO oslo.privsep.daemon [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Spawned new privsep daemon via rootwrap
Apr 11 19:22:24 user nova-compute[82196]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 19:22:24 user nova-compute[82196]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 19:22:24 user nova-compute[82196]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 11 19:22:24 user nova-compute[82196]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91954
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:24 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Instance spawned successfully.
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28beec8-9ee6-4292-a6e7-c5615454f156]: (2,) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.network.neutron [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Updated VIF entry in instance network info cache for port 031df3cc-5433-459d-ab9b-484629289e90. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.network.neutron [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Updating instance_info_cache with network_info: [{"id": "031df3cc-5433-459d-ab9b-484629289e90", "address": "fa:16:3e:b6:4d:98", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031df3cc-54", "ovs_interfaceid": "031df3cc-5433-459d-ab9b-484629289e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:24 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a49d379e-3976-4d68-b6df-f572a922107c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240944.5164158, a49d379e-3976-4d68-b6df-f572a922107c => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:24 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a49d379e-3976-4d68-b6df-f572a922107c] VM Started (Lifecycle Event)
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-540b170b-9943-4c67-a7d4-f5197d352f9e req-35224782-4082-4d9c-b0ad-dec3a8bb0f30 service nova] Releasing lock "refresh_cache-9941d033-15c2-4069-b9a6-f80840e95a38" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:24 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a49d379e-3976-4d68-b6df-f572a922107c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:24 user nova-compute[82196]: INFO nova.compute.manager [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Took 8.07 seconds to spawn the instance on the hypervisor.
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[039f6f38-df37-469d-8223-c278d2f6f20c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:24 user nova-compute[82196]: WARNING os_brick.initiator.connectors.nvmeof [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9cd3f9-40c3-4372-9851-85c6913b077e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[08feb260-96be-4d3a-bcf8-67af2ee55cc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bd80da-f82b-4d91-aaad-69a01360825c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:22:24 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:22:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cd5bdb-208f-402f-8924-37621daffb29]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG os_brick.utils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] <== get_connector_properties: return (2874ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating existing volume attachment record: 4dc914c9-c7f6-468a-9e0a-ce2706dec328 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:22:24 user nova-compute[82196]: INFO nova.compute.manager [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Took 9.54 seconds to build instance.
Apr 11 19:22:24 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Successfully created port: 576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c7e8024-5649-40b6-b7e1-b8340618e3c1 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a49d379e-3976-4d68-b6df-f572a922107c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.network.neutron [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Successfully updated port: 64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquired lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.network.neutron [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received event network-changed-64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Refreshing instance network info cache due to event network-changed-64bd141d-04e6-46e6-bb46-e997d3234fa1. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] Acquiring lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.891s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.network.neutron [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.network.neutron [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] There are 0 instances to clean {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82196) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:22:25 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:22:25 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Creating image(s)
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "/opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "/opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.policy [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c9641ceb17e4914b1cdf061c5bdc79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543456a70d04d7f8c50f37e64b7ee9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Successfully created port: db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.181s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk 1073741824" returned: 0 in 0.066s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.177s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.network.neutron [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Updating instance_info_cache with network_info: [{"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Releasing lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Instance network_info: |[{"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] Acquired lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.network.neutron [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Refreshing network info cache for port 64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Start _get_guest_xml network_info=[{"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:22:26 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:26 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1612946736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1612946736',id=8,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkMpWQuEm1Fv+W/mgY2OYSpggOfZUkoqqxBP4ppJK2h2yfEMM/I7umHLLvv+GHOLnvt+9wKNIfVoID5wNvYw3ZjffzrYq9zAWGLTOYlDtqreEy1EmtTM6C5cfTlcrcO1Q==',key_name='tempest-keypair-1575443570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f39e7fdf571442b0a6f136020a99f7fb',ramdisk_id='',reservation_id='r-fla1mq5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1678913086',owner_user_name='tempest-TaggedAttachmentsTest-1678913086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f84e7cbdf6a4e588753fea907beba0c',uuid=b71d95ed-728d-4386-b7c6-50b252718ca9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converting VIF {"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:20:b8,bridge_name='br-int',has_traffic_filtering=True,id=64bd141d-04e6-46e6-bb46-e997d3234fa1,network=Network(b8acbf9d-6e60-4540-9c11-751b6c4fac3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd141d-04') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.objects.instance [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lazy-loading 'pci_devices' on Instance uuid b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Received event network-vif-plugged-8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] Acquiring lock "1ded3918-3bae-465c-a53c-e88011914c50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] Lock "1ded3918-3bae-465c-a53c-e88011914c50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] Lock "1ded3918-3bae-465c-a53c-e88011914c50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] No waiting events found dispatching network-vif-plugged-8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:26 user nova-compute[82196]: WARNING nova.compute.manager [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Received unexpected event network-vif-plugged-8f590426-373c-4a90-8829-a2ad1a61fcd7 for instance with vm_state building and task_state spawning.
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Received event network-vif-plugged-8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] Acquiring lock "1ded3918-3bae-465c-a53c-e88011914c50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] Lock "1ded3918-3bae-465c-a53c-e88011914c50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] Lock "1ded3918-3bae-465c-a53c-e88011914c50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] No waiting events found dispatching network-vif-plugged-8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:26 user nova-compute[82196]: WARNING nova.compute.manager [req-3cd8447f-1482-4c2b-88e3-4f81e2f2b159 req-d2f6aa19-bd75-4e1e-afc5-50ea1ff73da0 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Received unexpected event network-vif-plugged-8f590426-373c-4a90-8829-a2ad1a61fcd7 for instance with vm_state building and task_state spawning.
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Cannot resize image /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.objects.instance [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lazy-loading 'migration_context' on Instance uuid 8e449d09-f632-4f57-b304-430734096596 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:22:26 user nova-compute[82196]:   <uuid>b71d95ed-728d-4386-b7c6-50b252718ca9</uuid>
Apr 11 19:22:26 user nova-compute[82196]:   <name>instance-00000008</name>
Apr 11 19:22:26 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:22:26 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:22:26 user nova-compute[82196]:   <metadata>
Apr 11 19:22:26 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:22:26 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:22:26 user nova-compute[82196]:       <nova:name>tempest-device-tagging-server-1612946736</nova:name>
Apr 11 19:22:26 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:22:26</nova:creationTime>
Apr 11 19:22:26 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:22:26 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:22:26 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:22:26 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:22:26 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:22:26 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:22:26 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:22:26 user nova-compute[82196]:       <nova:owner>
Apr 11 19:22:26 user nova-compute[82196]:         <nova:user uuid="2f84e7cbdf6a4e588753fea907beba0c">tempest-TaggedAttachmentsTest-1678913086-project-member</nova:user>
Apr 11 19:22:26 user nova-compute[82196]:         <nova:project uuid="f39e7fdf571442b0a6f136020a99f7fb">tempest-TaggedAttachmentsTest-1678913086</nova:project>
Apr 11 19:22:26 user nova-compute[82196]:       </nova:owner>
Apr 11 19:22:26 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:22:26 user nova-compute[82196]:       <nova:ports>
Apr 11 19:22:26 user nova-compute[82196]:         <nova:port uuid="64bd141d-04e6-46e6-bb46-e997d3234fa1">
Apr 11 19:22:26 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:22:26 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:26 user nova-compute[82196]:       </nova:ports>
Apr 11 19:22:26 user nova-compute[82196]:     </nova:instance>
Apr 11 19:22:26 user nova-compute[82196]:   </metadata>
Apr 11 19:22:26 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:22:26 user nova-compute[82196]:     <system>
Apr 11 19:22:26 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:22:26 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:22:26 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:22:26 user nova-compute[82196]:       <entry name="serial">b71d95ed-728d-4386-b7c6-50b252718ca9</entry>
Apr 11 19:22:26 user nova-compute[82196]:       <entry name="uuid">b71d95ed-728d-4386-b7c6-50b252718ca9</entry>
Apr 11 19:22:26 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:22:26 user nova-compute[82196]:     </system>
Apr 11 19:22:26 user nova-compute[82196]:   </sysinfo>
Apr 11 19:22:26 user nova-compute[82196]:   <os>
Apr 11 19:22:26 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:22:26 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:22:26 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:22:26 user nova-compute[82196]:   </os>
Apr 11 19:22:26 user nova-compute[82196]:   <features>
Apr 11 19:22:26 user nova-compute[82196]:     <acpi/>
Apr 11 19:22:26 user nova-compute[82196]:     <apic/>
Apr 11 19:22:26 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:22:26 user nova-compute[82196]:   </features>
Apr 11 19:22:26 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:22:26 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:22:26 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:22:26 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:22:26 user nova-compute[82196]:   </clock>
Apr 11 19:22:26 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:22:26 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:22:26 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:22:26 user nova-compute[82196]:   </cpu>
Apr 11 19:22:26 user nova-compute[82196]:   <devices>
Apr 11 19:22:26 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:22:26 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:22:26 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk"/>
Apr 11 19:22:26 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:22:26 user nova-compute[82196]:     </disk>
Apr 11 19:22:26 user nova-compute[82196]:     <disk type="file" device="cdrom">
Apr 11 19:22:26 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 19:22:26 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk.config"/>
Apr 11 19:22:26 user nova-compute[82196]:       <target dev="hda" bus="ide"/>
Apr 11 19:22:26 user nova-compute[82196]:     </disk>
Apr 11 19:22:26 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:26 user nova-compute[82196]:       <mac address="fa:16:3e:85:20:b8"/>
Apr 11 19:22:26 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:26 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:26 user nova-compute[82196]:       <target dev="tap64bd141d-04"/>
Apr 11 19:22:26 user nova-compute[82196]:     </interface>
Apr 11 19:22:26 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:22:26 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/console.log" append="off"/>
Apr 11 19:22:26 user nova-compute[82196]:     </serial>
Apr 11 19:22:26 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:22:26 user nova-compute[82196]:     <video>
Apr 11 19:22:26 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:26 user nova-compute[82196]:     </video>
Apr 11 19:22:26 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:22:26 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:22:26 user nova-compute[82196]:     </rng>
Apr 11 19:22:26 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:22:26 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:22:26 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:22:26 user nova-compute[82196]:     </memballoon>
Apr 11 19:22:26 user nova-compute[82196]:   </devices>
Apr 11 19:22:26 user nova-compute[82196]: </domain>
Apr 11 19:22:26 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1612946736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1612946736',id=8,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkMpWQuEm1Fv+W/mgY2OYSpggOfZUkoqqxBP4ppJK2h2yfEMM/I7umHLLvv+GHOLnvt+9wKNIfVoID5wNvYw3ZjffzrYq9zAWGLTOYlDtqreEy1EmtTM6C5cfTlcrcO1Q==',key_name='tempest-keypair-1575443570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f39e7fdf571442b0a6f136020a99f7fb',ramdisk_id='',reservation_id='r-fla1mq5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1678913086',owner_user_name='tempest-TaggedAttachmentsTest-1678913086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f84e7cbdf6a4e588753fea907beba0c',uuid=b71d95ed-728d-4386-b7c6-50b252718ca9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converting VIF {"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:20:b8,bridge_name='br-int',has_traffic_filtering=True,id=64bd141d-04e6-46e6-bb46-e997d3234fa1,network=Network(b8acbf9d-6e60-4540-9c11-751b6c4fac3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd141d-04') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG os_vif [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:20:b8,bridge_name='br-int',has_traffic_filtering=True,id=64bd141d-04e6-46e6-bb46-e997d3234fa1,network=Network(b8acbf9d-6e60-4540-9c11-751b6c4fac3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd141d-04') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Ensure instance console log exists: /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64bd141d-04, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64bd141d-04, col_values=(('external_ids', {'iface-id': '64bd141d-04e6-46e6-bb46-e997d3234fa1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:20:b8', 'vm-uuid': 'b71d95ed-728d-4386-b7c6-50b252718ca9'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:26 user nova-compute[82196]: INFO os_vif [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:20:b8,bridge_name='br-int',has_traffic_filtering=True,id=64bd141d-04e6-46e6-bb46-e997d3234fa1,network=Network(b8acbf9d-6e60-4540-9c11-751b6c4fac3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd141d-04')
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] No BDM found with device name hda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] No VIF found with MAC fa:16:3e:85:20:b8, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:22:26 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Using config drive
Apr 11 19:22:26 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Successfully created port: 66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:26 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Creating config drive at /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk.config
Apr 11 19:22:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjmsczp6k {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjmsczp6k" returned: 0 in 0.056s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:27 user nova-compute[82196]: DEBUG nova.compute.manager [req-97a38913-ada4-4c30-9df0-b3f1137996a2 req-8bfd66c7-ce72-4d7c-b2cd-960bcd14987e service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Received event network-vif-plugged-031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-97a38913-ada4-4c30-9df0-b3f1137996a2 req-8bfd66c7-ce72-4d7c-b2cd-960bcd14987e service nova] Acquiring lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-97a38913-ada4-4c30-9df0-b3f1137996a2 req-8bfd66c7-ce72-4d7c-b2cd-960bcd14987e service nova] Lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-97a38913-ada4-4c30-9df0-b3f1137996a2 req-8bfd66c7-ce72-4d7c-b2cd-960bcd14987e service nova] Lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:27 user nova-compute[82196]: DEBUG nova.compute.manager [req-97a38913-ada4-4c30-9df0-b3f1137996a2 req-8bfd66c7-ce72-4d7c-b2cd-960bcd14987e service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] No waiting events found dispatching network-vif-plugged-031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:27 user nova-compute[82196]: WARNING nova.compute.manager [req-97a38913-ada4-4c30-9df0-b3f1137996a2 req-8bfd66c7-ce72-4d7c-b2cd-960bcd14987e service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Received unexpected event network-vif-plugged-031df3cc-5433-459d-ab9b-484629289e90 for instance with vm_state building and task_state spawning.
Apr 11 19:22:27 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Successfully created port: 7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:27 user nova-compute[82196]: DEBUG nova.network.neutron [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Updated VIF entry in instance network info cache for port 64bd141d-04e6-46e6-bb46-e997d3234fa1. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:22:27 user nova-compute[82196]: DEBUG nova.network.neutron [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Updating instance_info_cache with network_info: [{"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a1825abf-4597-4113-a4c2-588961c73992 req-d617e050-7e8d-4f26-837c-df361ddf717b service nova] Releasing lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.network.neutron [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Successfully created port: 5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240948.436881, 1ded3918-3bae-465c-a53c-e88011914c50 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:28 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] VM Resumed (Lifecycle Event)
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:22:28 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Instance spawned successfully.
Apr 11 19:22:28 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:28 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240948.4457047, 1ded3918-3bae-465c-a53c-e88011914c50 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:28 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] VM Started (Lifecycle Event)
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:28 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Successfully updated port: aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:28 user nova-compute[82196]: INFO nova.compute.manager [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Took 13.77 seconds to spawn the instance on the hypervisor.
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240948.7808304, 9941d033-15c2-4069-b9a6-f80840e95a38 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:28 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] VM Resumed (Lifecycle Event)
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-changed-aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing instance network info cache due to event network-changed-aeb74c01-d96e-4838-8d2c-c2499e3f8770. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] Acquiring lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] Acquired lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.network.neutron [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing network info cache for port aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:28 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Instance spawned successfully.
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:28 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240948.7809846, 9941d033-15c2-4069-b9a6-f80840e95a38 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:28 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] VM Started (Lifecycle Event)
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:28 user nova-compute[82196]: INFO nova.compute.manager [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Took 14.84 seconds to build instance.
Apr 11 19:22:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8156b66-76f0-459f-821d-767c6e9f4913 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "1ded3918-3bae-465c-a53c-e88011914c50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.997s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:29 user nova-compute[82196]: INFO nova.compute.manager [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Took 11.41 seconds to spawn the instance on the hypervisor.
Apr 11 19:22:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:29 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:29 user nova-compute[82196]: DEBUG nova.network.neutron [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:29 user nova-compute[82196]: INFO nova.compute.manager [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Took 12.61 seconds to build instance.
Apr 11 19:22:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7f078375-7ee9-4891-890a-1d90d2db16d8 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "9941d033-15c2-4069-b9a6-f80840e95a38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.794s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Received event network-vif-plugged-031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] Acquiring lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] Lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] Lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] No waiting events found dispatching network-vif-plugged-031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:29 user nova-compute[82196]: WARNING nova.compute.manager [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Received unexpected event network-vif-plugged-031df3cc-5433-459d-ab9b-484629289e90 for instance with vm_state active and task_state None.
Apr 11 19:22:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received event network-vif-plugged-64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] Acquiring lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] No waiting events found dispatching network-vif-plugged-64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:29 user nova-compute[82196]: WARNING nova.compute.manager [req-af67c7f5-49c1-449b-b216-cabb7b44b772 req-4bfc39b6-dbde-4a17-be9b-1b213101446d service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received unexpected event network-vif-plugged-64bd141d-04e6-46e6-bb46-e997d3234fa1 for instance with vm_state building and task_state spawning.
Apr 11 19:22:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Successfully updated port: 4768cc5b-e792-4c52-805a-7f288ed9fbe5 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG nova.network.neutron [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Skipping network cache update for instance because it is Building. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Skipping network cache update for instance because it is Building. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 8e449d09-f632-4f57-b304-430734096596] Skipping network cache update for instance because it is Building. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0ed94ec8-1624-4fd3-9d64-4fc9f57bbb09 req-0ae57640-2a5a-4762-829f-0f3f04583cb0 service nova] Releasing lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG nova.compute.manager [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-changed-4768cc5b-e792-4c52-805a-7f288ed9fbe5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG nova.compute.manager [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing instance network info cache due to event network-changed-4768cc5b-e792-4c52-805a-7f288ed9fbe5. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] Acquiring lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] Acquired lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:30 user nova-compute[82196]: DEBUG nova.network.neutron [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing network info cache for port 4768cc5b-e792-4c52-805a-7f288ed9fbe5 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Successfully updated port: 1d14016e-af6d-4ce8-bd51-8a9dba7c4261 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:31 user nova-compute[82196]: INFO nova.virt.block_device [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Booting with volume 125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 at /dev/vdb
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.network.neutron [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG os_brick.utils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[df79d5f9-a721-4a34-8da6-7537e624e7aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0874c4-054f-433f-81a0-2848a1d8f10c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[55441de5-8cf5-4f8e-befa-6a4bc2ad6c4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba7afe2-c78b-4bae-9033-59583c6084f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240951.353176, b71d95ed-728d-4386-b7c6-50b252718ca9 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:31 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] VM Resumed (Lifecycle Event)
Apr 11 19:22:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.compute.manager [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:22:31 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b67254a-860a-45ef-9ae8-4f3393441f49]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG os_brick.utils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] <== get_connector_properties: return (215ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating existing volume attachment record: fbe295b0-ec7a-42be-8af4-c4acb67d9349 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:22:31 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Instance spawned successfully.
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:31 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240951.3536432, b71d95ed-728d-4386-b7c6-50b252718ca9 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:31 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] VM Started (Lifecycle Event)
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-1cab330d-f3a7-4794-848a-1c4c6914891e req-55713116-dc4e-4c4e-8901-e1827a70cac2 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received event network-vif-plugged-64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1cab330d-f3a7-4794-848a-1c4c6914891e req-55713116-dc4e-4c4e-8901-e1827a70cac2 service nova] Acquiring lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1cab330d-f3a7-4794-848a-1c4c6914891e req-55713116-dc4e-4c4e-8901-e1827a70cac2 service nova] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1cab330d-f3a7-4794-848a-1c4c6914891e req-55713116-dc4e-4c4e-8901-e1827a70cac2 service nova] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-1cab330d-f3a7-4794-848a-1c4c6914891e req-55713116-dc4e-4c4e-8901-e1827a70cac2 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] No waiting events found dispatching network-vif-plugged-64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:31 user nova-compute[82196]: WARNING nova.compute.manager [req-1cab330d-f3a7-4794-848a-1c4c6914891e req-55713116-dc4e-4c4e-8901-e1827a70cac2 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received unexpected event network-vif-plugged-64bd141d-04e6-46e6-bb46-e997d3234fa1 for instance with vm_state building and task_state spawning.
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:31 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.network.neutron [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Successfully updated port: 5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "refresh_cache-8e449d09-f632-4f57-b304-430734096596" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquired lock "refresh_cache-8e449d09-f632-4f57-b304-430734096596" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.network.neutron [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:22:31 user nova-compute[82196]: INFO nova.compute.manager [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Took 11.14 seconds to spawn the instance on the hypervisor.
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.compute.manager [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:31 user nova-compute[82196]: INFO nova.compute.manager [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Took 12.21 seconds to build instance.
Apr 11 19:22:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-550052ab-f7e6-4eba-9439-95afd6559901 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.353s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:31 user nova-compute[82196]: DEBUG nova.network.neutron [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e47d6b15-d02e-4904-9309-a9bd9ef666a7 req-03b06391-9551-4734-b9ad-4986052fb4c3 service nova] Releasing lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG nova.network.neutron [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Successfully updated port: 576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Updating instance_info_cache with network_info: [{"id": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "address": "fa:16:3e:c2:7d:b5", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4beb6cf-d1", "ovs_interfaceid": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-changed-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing instance network info cache due to event network-changed-1d14016e-af6d-4ce8-bd51-8a9dba7c4261. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] Acquiring lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] Acquired lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:32 user nova-compute[82196]: DEBUG nova.network.neutron [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing network info cache for port 1d14016e-af6d-4ce8-bd51-8a9dba7c4261 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.network.neutron [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Updating instance_info_cache with network_info: [{"id": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "address": "fa:16:3e:ca:c6:e4", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dea909b-ea", "ovs_interfaceid": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.network.neutron [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Releasing lock "refresh_cache-8e449d09-f632-4f57-b304-430734096596" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.compute.manager [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Instance network_info: |[{"id": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "address": "fa:16:3e:ca:c6:e4", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dea909b-ea", "ovs_interfaceid": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Start _get_guest_xml network_info=[{"id": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "address": "fa:16:3e:ca:c6:e4", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dea909b-ea", "ovs_interfaceid": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:22:33 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:33 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1077608511',display_name='tempest-VolumesActionsTest-instance-1077608511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1077608511',id=10,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7543456a70d04d7f8c50f37e64b7ee9c',ramdisk_id='',reservation_id='r-xt2ua9hy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2124197416',owner_user_name='tempest-VolumesActionsTest-2124197416-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:26Z,user_data=None,user_id='7c9641ceb17e4914b1cdf061c5bdc79f',uuid=8e449d09-f632-4f57-b304-430734096596,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "address": "fa:16:3e:ca:c6:e4", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dea909b-ea", "ovs_interfaceid": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Converting VIF {"id": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "address": "fa:16:3e:ca:c6:e4", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dea909b-ea", "ovs_interfaceid": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=5dea909b-eaed-4978-b239-4177f6cbdfdc,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dea909b-ea') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.objects.instance [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e449d09-f632-4f57-b304-430734096596 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk --force-share --output=json" returned: 0 in 0.487s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:22:33 user nova-compute[82196]:   <uuid>8e449d09-f632-4f57-b304-430734096596</uuid>
Apr 11 19:22:33 user nova-compute[82196]:   <name>instance-0000000a</name>
Apr 11 19:22:33 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:22:33 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:22:33 user nova-compute[82196]:   <metadata>
Apr 11 19:22:33 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:22:33 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:22:33 user nova-compute[82196]:       <nova:name>tempest-VolumesActionsTest-instance-1077608511</nova:name>
Apr 11 19:22:33 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:22:33</nova:creationTime>
Apr 11 19:22:33 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:22:33 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:22:33 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:22:33 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:22:33 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:22:33 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:22:33 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:22:33 user nova-compute[82196]:       <nova:owner>
Apr 11 19:22:33 user nova-compute[82196]:         <nova:user uuid="7c9641ceb17e4914b1cdf061c5bdc79f">tempest-VolumesActionsTest-2124197416-project-member</nova:user>
Apr 11 19:22:33 user nova-compute[82196]:         <nova:project uuid="7543456a70d04d7f8c50f37e64b7ee9c">tempest-VolumesActionsTest-2124197416</nova:project>
Apr 11 19:22:33 user nova-compute[82196]:       </nova:owner>
Apr 11 19:22:33 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:22:33 user nova-compute[82196]:       <nova:ports>
Apr 11 19:22:33 user nova-compute[82196]:         <nova:port uuid="5dea909b-eaed-4978-b239-4177f6cbdfdc">
Apr 11 19:22:33 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 11 19:22:33 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:33 user nova-compute[82196]:       </nova:ports>
Apr 11 19:22:33 user nova-compute[82196]:     </nova:instance>
Apr 11 19:22:33 user nova-compute[82196]:   </metadata>
Apr 11 19:22:33 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:22:33 user nova-compute[82196]:     <system>
Apr 11 19:22:33 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:22:33 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:22:33 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:22:33 user nova-compute[82196]:       <entry name="serial">8e449d09-f632-4f57-b304-430734096596</entry>
Apr 11 19:22:33 user nova-compute[82196]:       <entry name="uuid">8e449d09-f632-4f57-b304-430734096596</entry>
Apr 11 19:22:33 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:22:33 user nova-compute[82196]:     </system>
Apr 11 19:22:33 user nova-compute[82196]:   </sysinfo>
Apr 11 19:22:33 user nova-compute[82196]:   <os>
Apr 11 19:22:33 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:22:33 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:22:33 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:22:33 user nova-compute[82196]:   </os>
Apr 11 19:22:33 user nova-compute[82196]:   <features>
Apr 11 19:22:33 user nova-compute[82196]:     <acpi/>
Apr 11 19:22:33 user nova-compute[82196]:     <apic/>
Apr 11 19:22:33 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:22:33 user nova-compute[82196]:   </features>
Apr 11 19:22:33 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:22:33 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:22:33 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:22:33 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:22:33 user nova-compute[82196]:   </clock>
Apr 11 19:22:33 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:22:33 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:22:33 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:22:33 user nova-compute[82196]:   </cpu>
Apr 11 19:22:33 user nova-compute[82196]:   <devices>
Apr 11 19:22:33 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:22:33 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:22:33 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk"/>
Apr 11 19:22:33 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:22:33 user nova-compute[82196]:     </disk>
Apr 11 19:22:33 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:33 user nova-compute[82196]:       <mac address="fa:16:3e:ca:c6:e4"/>
Apr 11 19:22:33 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:33 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:33 user nova-compute[82196]:       <target dev="tap5dea909b-ea"/>
Apr 11 19:22:33 user nova-compute[82196]:     </interface>
Apr 11 19:22:33 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:22:33 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/console.log" append="off"/>
Apr 11 19:22:33 user nova-compute[82196]:     </serial>
Apr 11 19:22:33 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:22:33 user nova-compute[82196]:     <video>
Apr 11 19:22:33 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:33 user nova-compute[82196]:     </video>
Apr 11 19:22:33 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:22:33 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:22:33 user nova-compute[82196]:     </rng>
Apr 11 19:22:33 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:22:33 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:22:33 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:22:33 user nova-compute[82196]:     </memballoon>
Apr 11 19:22:33 user nova-compute[82196]:   </devices>
Apr 11 19:22:33 user nova-compute[82196]: </domain>
Apr 11 19:22:33 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1077608511',display_name='tempest-VolumesActionsTest-instance-1077608511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1077608511',id=10,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7543456a70d04d7f8c50f37e64b7ee9c',ramdisk_id='',reservation_id='r-xt2ua9hy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2124197416',owner_user_name='tempest-VolumesActionsTest-2124197416-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:26Z,user_data=None,user_id='7c9641ceb17e4914b1cdf061c5bdc79f',uuid=8e449d09-f632-4f57-b304-430734096596,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "address": "fa:16:3e:ca:c6:e4", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dea909b-ea", "ovs_interfaceid": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Converting VIF {"id": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "address": "fa:16:3e:ca:c6:e4", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dea909b-ea", "ovs_interfaceid": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=5dea909b-eaed-4978-b239-4177f6cbdfdc,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dea909b-ea') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG os_vif [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=5dea909b-eaed-4978-b239-4177f6cbdfdc,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dea909b-ea') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dea909b-ea, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5dea909b-ea, col_values=(('external_ids', {'iface-id': '5dea909b-eaed-4978-b239-4177f6cbdfdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:c6:e4', 'vm-uuid': '8e449d09-f632-4f57-b304-430734096596'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:33 user nova-compute[82196]: INFO os_vif [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=5dea909b-eaed-4978-b239-4177f6cbdfdc,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dea909b-ea')
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.compute.manager [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Received event network-changed-5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.compute.manager [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Refreshing instance network info cache due to event network-changed-5dea909b-eaed-4978-b239-4177f6cbdfdc. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] Acquiring lock "refresh_cache-8e449d09-f632-4f57-b304-430734096596" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] Acquired lock "refresh_cache-8e449d09-f632-4f57-b304-430734096596" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.network.neutron [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Refreshing network info cache for port 5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] No VIF found with MAC fa:16:3e:ca:c6:e4, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.network.neutron [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] Releasing lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.compute.manager [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-changed-576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.compute.manager [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing instance network info cache due to event network-changed-576d5a47-cb3a-4794-bc1e-dcbb82e25352. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] Acquiring lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] Acquired lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG nova.network.neutron [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing network info cache for port 576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:34 user nova-compute[82196]: DEBUG nova.network.neutron [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:34 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Successfully updated port: db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG nova.compute.manager [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-changed-db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG nova.compute.manager [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing instance network info cache due to event network-changed-db299c0f-eae0-45ae-ba9c-037c50e06a3c. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] Acquiring lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG nova.network.neutron [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG nova.network.neutron [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Updated VIF entry in instance network info cache for port 5dea909b-eaed-4978-b239-4177f6cbdfdc. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG nova.network.neutron [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Updating instance_info_cache with network_info: [{"id": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "address": "fa:16:3e:ca:c6:e4", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dea909b-ea", "ovs_interfaceid": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2aeaf3d-a04a-457d-8464-f4cefa6e975c req-f31b30e3-498c-4a9c-b51a-3ec4c47f8d50 service nova] Releasing lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] Acquired lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG nova.network.neutron [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing network info cache for port db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1bcdfd49-3415-472d-9cc0-5fece917cd4f req-bf301b48-0b41-4d34-855d-28e5c0f48f31 service nova] Releasing lock "refresh_cache-8e449d09-f632-4f57-b304-430734096596" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG nova.network.neutron [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Successfully updated port: 66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG nova.compute.manager [req-0aba7f93-08a0-4c2d-bc03-30e29830a12a req-cf7fe974-f923-4c62-aed5-6ceab8e90c2f service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Received event network-vif-plugged-5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0aba7f93-08a0-4c2d-bc03-30e29830a12a req-cf7fe974-f923-4c62-aed5-6ceab8e90c2f service nova] Acquiring lock "8e449d09-f632-4f57-b304-430734096596-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0aba7f93-08a0-4c2d-bc03-30e29830a12a req-cf7fe974-f923-4c62-aed5-6ceab8e90c2f service nova] Lock "8e449d09-f632-4f57-b304-430734096596-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0aba7f93-08a0-4c2d-bc03-30e29830a12a req-cf7fe974-f923-4c62-aed5-6ceab8e90c2f service nova] Lock "8e449d09-f632-4f57-b304-430734096596-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG nova.compute.manager [req-0aba7f93-08a0-4c2d-bc03-30e29830a12a req-cf7fe974-f923-4c62-aed5-6ceab8e90c2f service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] No waiting events found dispatching network-vif-plugged-5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:35 user nova-compute[82196]: WARNING nova.compute.manager [req-0aba7f93-08a0-4c2d-bc03-30e29830a12a req-cf7fe974-f923-4c62-aed5-6ceab8e90c2f service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Received unexpected event network-vif-plugged-5dea909b-eaed-4978-b239-4177f6cbdfdc for instance with vm_state building and task_state spawning.
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.008s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:22:36 user nova-compute[82196]: INFO nova.compute.claims [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Claim successful on node user
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG nova.network.neutron [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-762b84a3-16dc-4bf6-b74a-e98db0e2b361 req-a5aec127-6150-491b-a212-9a446d1f2836 service nova] Releasing lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Refreshing inventories for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Updating ProviderTree inventory for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Updating inventory in ProviderTree for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Refreshing aggregate associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, aggregates: None {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Refreshing trait associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Successfully updated port: 7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquired lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240958.1183434, 8e449d09-f632-4f57-b304-430734096596 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:38 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8e449d09-f632-4f57-b304-430734096596] VM Resumed (Lifecycle Event)
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-changed-66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing instance network info cache due to event network-changed-66cd1e83-c736-444c-84c7-ecfc2c2b3802. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] Acquiring lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-1dee66fb-4270-43c8-81bc-16014dff8e2d req-7d76800a-4a32-4b67-aed1-3845bb857db6 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Received event network-vif-plugged-5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1dee66fb-4270-43c8-81bc-16014dff8e2d req-7d76800a-4a32-4b67-aed1-3845bb857db6 service nova] Acquiring lock "8e449d09-f632-4f57-b304-430734096596-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1dee66fb-4270-43c8-81bc-16014dff8e2d req-7d76800a-4a32-4b67-aed1-3845bb857db6 service nova] Lock "8e449d09-f632-4f57-b304-430734096596-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1dee66fb-4270-43c8-81bc-16014dff8e2d req-7d76800a-4a32-4b67-aed1-3845bb857db6 service nova] Lock "8e449d09-f632-4f57-b304-430734096596-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-1dee66fb-4270-43c8-81bc-16014dff8e2d req-7d76800a-4a32-4b67-aed1-3845bb857db6 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] No waiting events found dispatching network-vif-plugged-5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:38 user nova-compute[82196]: WARNING nova.compute.manager [req-1dee66fb-4270-43c8-81bc-16014dff8e2d req-7d76800a-4a32-4b67-aed1-3845bb857db6 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Received unexpected event network-vif-plugged-5dea909b-eaed-4978-b239-4177f6cbdfdc for instance with vm_state building and task_state spawning.
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:22:38 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:38 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7818MB free_disk=26.725357055664062GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:38 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 8e449d09-f632-4f57-b304-430734096596] Instance spawned successfully.
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8e449d09-f632-4f57-b304-430734096596] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8e449d09-f632-4f57-b304-430734096596] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:38 user nova-compute[82196]: INFO nova.virt.block_device [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Booting with volume 0b6fb879-bd91-4f68-a952-095dadc5eaef at /dev/vdc
Apr 11 19:22:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.729s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.136s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:38 user nova-compute[82196]: INFO nova.compute.manager [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Took 13.21 seconds to spawn the instance on the hypervisor.
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:38 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8e449d09-f632-4f57-b304-430734096596] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240958.1201386, 8e449d09-f632-4f57-b304-430734096596 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:38 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8e449d09-f632-4f57-b304-430734096596] VM Started (Lifecycle Event)
Apr 11 19:22:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8e449d09-f632-4f57-b304-430734096596] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:22:38 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:22:38 user nova-compute[82196]: DEBUG os_brick.utils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8e449d09-f632-4f57-b304-430734096596] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f2aede-9264-4230-8182-a3b451c66a03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06734de-b2b1-453c-80a2-467122f366ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:39 user nova-compute[82196]: INFO nova.compute.manager [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Took 14.71 seconds to build instance.
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[73146e7e-7266-4423-8bae-b864e4bad314]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee53c00-b962-4810-bdb8-3b8bdf823ca8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-09b7b502-38e1-472d-acbf-cf8f56df8cb5 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "8e449d09-f632-4f57-b304-430734096596" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.962s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:22:39 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22184db-ee17-4f97-a8e9-6177179031ac]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG os_brick.utils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating existing volume attachment record: e48a98e0-7f37-4b57-a64e-9778b7413481 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bed4001c-02c2-4c6b-84c8-61654df66d8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 1ded3918-3bae-465c-a53c-e88011914c50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance a49d379e-3976-4d68-b6df-f572a922107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9941d033-15c2-4069-b9a6-f80840e95a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance b71d95ed-728d-4386-b7c6-50b252718ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 8e449d09-f632-4f57-b304-430734096596 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:22:39 user nova-compute[82196]: INFO nova.virt.block_device [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Booting with volume 6cd6076d-a423-48e8-a9a6-e77019975089 at /dev/vda
Apr 11 19:22:39 user nova-compute[82196]: DEBUG os_brick.utils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede3c1cd-6a66-4c88-b3f1-8742d85ae915]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aeaaab-b350-412b-9571-9baba678cf27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f15be9-0b77-4e8e-9b31-0d2873bc90c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adcc454-d369-48e3-bbc8-620fff40957d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:22:39 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9b2a93-f7cd-445d-8c89-4781e4a54cd8]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG os_brick.utils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating existing volume attachment record: 9e941827-96ba-4bde-8409-31dad0700d9b {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.policy [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb69b26bc5af47069cdd00b39db75375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac81630b23345679b841ea2c3fe28f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:22:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.980s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:40 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Successfully created port: 59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:41 user nova-compute[82196]: DEBUG nova.network.neutron [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [{"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "address": "fa:16:3e:1a:59:78", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c8382-c8", "ovs_interfaceid": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Releasing lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Instance network_info: |[{"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "address": "fa:16:3e:1a:59:78", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c8382-c8", "ovs_interfaceid": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:22:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] Acquired lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:41 user nova-compute[82196]: DEBUG nova.network.neutron [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing network info cache for port 66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:42 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Successfully created port: cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:42 user nova-compute[82196]: DEBUG nova.network.neutron [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updated VIF entry in instance network info cache for port 66cd1e83-c736-444c-84c7-ecfc2c2b3802. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:22:42 user nova-compute[82196]: DEBUG nova.network.neutron [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [{"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "address": "fa:16:3e:1a:59:78", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c8382-c8", "ovs_interfaceid": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] Releasing lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:42 user nova-compute[82196]: DEBUG nova.compute.manager [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-changed-7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:42 user nova-compute[82196]: DEBUG nova.compute.manager [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing instance network info cache due to event network-changed-7e8c8382-c878-4ac7-b626-01cf2bc2f349. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] Acquiring lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] Acquired lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:42 user nova-compute[82196]: DEBUG nova.network.neutron [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing network info cache for port 7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:43 user nova-compute[82196]: DEBUG nova.network.neutron [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updated VIF entry in instance network info cache for port 7e8c8382-c878-4ac7-b626-01cf2bc2f349. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:22:43 user nova-compute[82196]: DEBUG nova.network.neutron [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [{"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "address": "fa:16:3e:1a:59:78", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c8382-c8", "ovs_interfaceid": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bc8df6b8-7e5c-47e0-bff4-7535cb19edbd req-4d5ae1e9-9212-4bca-b54c-45b7e0a0b28a service nova] Releasing lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:43 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Successfully created port: 8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:44 user nova-compute[82196]: INFO nova.virt.block_device [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Booting with volume cc002f3d-0af6-486e-beea-3bcc54a9a101 at /dev/vdb
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:22:44 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Creating image(s)
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Ensure instance console log exists: /opt/stack/data/nova/instances/dde6b4d2-9288-474c-b400-ce3b6f393b24/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Start _get_guest_xml network_info=[{"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "address": "fa:16:3e:1a:59:78", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c8382-c8", "ovs_interfaceid": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMjOdxbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dde6b4d2-9288-474c-b400-ce3b6f393b24', 'attached_at': '', 'detached_at': '', 'volume_id': 'a38d7c75-168f-480e-8f42-0c2606086f09', 'serial': 'a38d7c75-168f-480e-8f42-0c2606086f09'}, 'attachment_id': '4dc914c9-c7f6-468a-9e0a-ce2706dec328', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnKdoRUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dde6b4d2-9288-474c-b400-ce3b6f393b24', 'attached_at': '', 'detached_at': '', 'volume_id': '125a0bcb-5bbf-4fa8-81f5-f9054a4a2235', 'serial': '125a0bcb-5bbf-4fa8-81f5-f9054a4a2235'}, 'attachment_id': 'fbe295b0-ec7a-42be-8af4-c4acb67d9349', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': 1, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjxznITU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dde6b4d2-9288-474c-b400-ce3b6f393b24', 'attached_at': '', 'detached_at': '', 'volume_id': '0b6fb879-bd91-4f68-a952-095dadc5eaef', 'serial': '0b6fb879-bd91-4f68-a952-095dadc5eaef'}, 'attachment_id': 'e48a98e0-7f37-4b57-a64e-9778b7413481', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'boot_index': 2, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:22:44 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:44 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG os_brick.initiator.connector [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Factory for ISCSI on None {{(pid=82196) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMjOdxbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:22:44 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:22:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:22:44 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:22:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:22:44 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:22:44 user nova-compute[82196]: DEBUG os_brick.utils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fad138-820c-44d4-9c0a-a007e33f65ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:22:44 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f717779a-e383-4c5f-b68c-c8d6b3eba879]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[14686bec-c99b-4d67-8262-e65526d68b81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09] added
Apr 11 19:22:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc7fd13-82c3-434d-93c0-4099eb777431]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.036s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7715909-2021-48e1-9dc1-3bb4b8042125]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb845beb-bce5-4bd7-a641-f472aa3bb8a4]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMjOdxbp {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[362bf9fb-3183-4fa8-b174-5ef27708c507]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd50e4bd-eceb-411c-955b-c15e6eebd91a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMjOdxbp" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8579b3ba-1031-439b-89ad-891d30fae18c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GMjOdxbp'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Successfully created port: 1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:22:45 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c87f620-9c3b-4635-a105-97445b6905e1]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.utils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating existing volume attachment record: 3097b7cd-12eb-40e6-ab14-de13649ff7ac {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[830f7554-3c21-4df5-b6d5-b19a5481defb]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ca3b1e-8fae-4395-a5a5-e5dbf7a63b79]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 19:22:45 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 19:22:45 user nova-compute[82196]:  {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:22:45 user nova-compute[82196]: WARNING os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 19:22:45 user nova-compute[82196]: 
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d855fe2-af87-4539-8413-7baab6e998e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09, portal: 172.16.0.220,3260]
Apr 11 19:22:45 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09, portal: 172.16.0.220,3260] successful.
Apr 11 19:22:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ca9180-cb78-4225-b6f4-91de61bb1ba3]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7025df-0069-4f04-87c5-240fc05bfe2f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.048s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fa059f-6c9e-463c-b3e5-9cc8612c866d]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMjOdxbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Successfully created port: 6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23539383830333539', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539383830333539', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnKdoRUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:22:46 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:22:46 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:22:46 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[295f731b-deec-4455-a9c7-4fc740b537a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:22:46 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[26be291f-e579-4c41-a623-b40b867b9b8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235] added
Apr 11 19:22:46 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[193f1a14-f7a0-4406-94d7-4092d63db8e5]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a94433-1df6-4344-84ef-c68ef6152896]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bnKdoRUP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bnKdoRUP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95f5a24-75c8-4d5c-8bed-249d09ed0f31]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bnKdoRUP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7e37dd-6bea-4803-88a5-c9c73586ad4d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e1693f-5dbb-46ff-b718-d6ea045eb7ee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:46 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:46 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Successfully updated port: 59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-changed-59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing instance network info cache due to event network-changed-59314c6a-6d9a-4586-a8de-27a566e58eb4. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] Acquiring lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] Acquired lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG nova.network.neutron [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing network info cache for port 59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e80420-766c-4b6f-ba7a-4c34d7885c24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235, portal: 172.16.0.220,3260]
Apr 11 19:22:46 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235, portal: 172.16.0.220,3260] successful.
Apr 11 19:22:46 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[84333d2d-371c-471b-ab4d-e644c0f55b05]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c6a3e3-8fcc-4b35-b24d-69ed4294cb93]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:46 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:46 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:46 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:46 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.034s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf29f90-4888-4c1b-8795-0706bd5f9510]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnKdoRUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:22:46 user nova-compute[82196]: DEBUG nova.network.neutron [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Successfully updated port: 986b85fe-4d6d-4ac6-95c7-02e58e4073b2 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-60553b95-e633-4966-87d5-dfb32379a0ed req-10b7e88b-5396-405b-a837-656113cb635e service nova] Releasing lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23334313861626333', 'path': '/dev/sdc'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334313861626333', 'path': '/dev/sdc'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjxznITU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:22:47 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:22:47 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:22:47 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[584dfc5d-ab50-4024-b5ea-9e83dc8a3b54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:22:47 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3518e25e-42a5-48a3-924f-1c4421d0b7a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef] added
Apr 11 19:22:47 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddae4abe-1313-41f6-9d77-27547f66eeb0]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[61085e5c-c51a-4fe3-9eaa-96d23b795b53]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tjxznITU {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tjxznITU" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb348e72-fa48-43db-8519-11540a450a5b]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tjxznITU'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ec3dae-7dec-4a77-92de-8661a6007d32]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:47 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Successfully updated port: f3db6cdb-4d7d-4c66-a809-d59e3feaea97 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ba1a97-3d9d-452e-a7fa-c2b9de89f9d7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:48 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:48 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9190c76e-a0c3-4115-9f45-72b0872d1ab4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef, portal: 172.16.0.220,3260]
Apr 11 19:22:48 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef, portal: 172.16.0.220,3260] successful.
Apr 11 19:22:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[858e6443-8d6d-456b-bb7a-6b084fe8e26a]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9083a12-d64a-47ed-b311-3928d810598a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:48 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:48 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:48 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:48 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[566001bb-0a0d-4dd6-9c2a-8a7f90b186e1]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjxznITU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-changed-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing instance network info cache due to event network-changed-986b85fe-4d6d-4ac6-95c7-02e58e4073b2. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] Acquiring lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] Acquired lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG nova.network.neutron [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing network info cache for port 986b85fe-4d6d-4ac6-95c7-02e58e4073b2 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Successfully updated port: cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG nova.network.neutron [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:48 user nova-compute[82196]: DEBUG nova.network.neutron [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] Releasing lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.compute.manager [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-changed-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.compute.manager [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing instance network info cache due to event network-changed-f3db6cdb-4d7d-4c66-a809-d59e3feaea97. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] Acquiring lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] Acquired lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.neutron [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing network info cache for port f3db6cdb-4d7d-4c66-a809-d59e3feaea97 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.neutron [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23838646430316233', 'path': '/dev/sdd'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838646430316233', 'path': '/dev/sdd'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:00:78,bridge_name='br-int',has_traffic_filtering=True,id=aeb74c01-d96e-4838-8d2c-c2499e3f8770,network=Network(17e7d3c3-aefe-4aac-82cb-be854d82b261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb74c01-d9') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=4768cc5b-e792-4c52-805a-7f288ed9fbe5,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4768cc5b-e7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:66:df,bridge_name='br-int',has_traffic_filtering=True,id=1d14016e-af6d-4ce8-bd51-8a9dba7c4261,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d14016e-af') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=576d5a47-cb3a-4794-bc1e-dcbb82e25352,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576d5a47-cb') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a4:70,bridge_name='br-int',has_traffic_filtering=True,id=db299c0f-eae0-45ae-ba9c-037c50e06a3c,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb299c0f-ea') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:3b:f1,bridge_name='br-int',has_traffic_filtering=True,id=66cd1e83-c736-444c-84c7-ecfc2c2b3802,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd1e83-c7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "address": "fa:16:3e:1a:59:78", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c8382-c8", "ovs_interfaceid": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "address": "fa:16:3e:1a:59:78", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c8382-c8", "ovs_interfaceid": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:78,bridge_name='br-int',has_traffic_filtering=True,id=7e8c8382-c878-4ac7-b626-01cf2bc2f349,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c8382-c8') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.objects.instance [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lazy-loading 'pci_devices' on Instance uuid dde6b4d2-9288-474c-b400-ce3b6f393b24 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:22:49 user nova-compute[82196]:   <uuid>dde6b4d2-9288-474c-b400-ce3b6f393b24</uuid>
Apr 11 19:22:49 user nova-compute[82196]:   <name>instance-00000009</name>
Apr 11 19:22:49 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:22:49 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:22:49 user nova-compute[82196]:   <metadata>
Apr 11 19:22:49 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:22:49 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:22:49 user nova-compute[82196]:       <nova:name>tempest-device-tagging-server-2047298222</nova:name>
Apr 11 19:22:49 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:22:44</nova:creationTime>
Apr 11 19:22:49 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:22:49 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:22:49 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:22:49 user nova-compute[82196]:       <nova:owner>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:user uuid="2f44f0d0807342ba9b851e7530a82294">tempest-TaggedBootDevicesTest_v242-1381679461-project-member</nova:user>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:project uuid="1afa97b49ae647c899a05d54b7f0f16b">tempest-TaggedBootDevicesTest_v242-1381679461</nova:project>
Apr 11 19:22:49 user nova-compute[82196]:       </nova:owner>
Apr 11 19:22:49 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:22:49 user nova-compute[82196]:       <nova:ports>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:port uuid="aeb74c01-d96e-4838-8d2c-c2499e3f8770">
Apr 11 19:22:49 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 19:22:49 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:port uuid="4768cc5b-e792-4c52-805a-7f288ed9fbe5">
Apr 11 19:22:49 user nova-compute[82196]:           <nova:ip type="fixed" address="10.1.1.247" ipVersion="4"/>
Apr 11 19:22:49 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:port uuid="1d14016e-af6d-4ce8-bd51-8a9dba7c4261">
Apr 11 19:22:49 user nova-compute[82196]:           <nova:ip type="fixed" address="10.1.1.26" ipVersion="4"/>
Apr 11 19:22:49 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:port uuid="576d5a47-cb3a-4794-bc1e-dcbb82e25352">
Apr 11 19:22:49 user nova-compute[82196]:           <nova:ip type="fixed" address="10.1.1.220" ipVersion="4"/>
Apr 11 19:22:49 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:port uuid="db299c0f-eae0-45ae-ba9c-037c50e06a3c">
Apr 11 19:22:49 user nova-compute[82196]:           <nova:ip type="fixed" address="10.1.1.232" ipVersion="4"/>
Apr 11 19:22:49 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:port uuid="66cd1e83-c736-444c-84c7-ecfc2c2b3802">
Apr 11 19:22:49 user nova-compute[82196]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 19:22:49 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:49 user nova-compute[82196]:         <nova:port uuid="7e8c8382-c878-4ac7-b626-01cf2bc2f349">
Apr 11 19:22:49 user nova-compute[82196]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 19:22:49 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:49 user nova-compute[82196]:       </nova:ports>
Apr 11 19:22:49 user nova-compute[82196]:     </nova:instance>
Apr 11 19:22:49 user nova-compute[82196]:   </metadata>
Apr 11 19:22:49 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:22:49 user nova-compute[82196]:     <system>
Apr 11 19:22:49 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:22:49 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:22:49 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:22:49 user nova-compute[82196]:       <entry name="serial">dde6b4d2-9288-474c-b400-ce3b6f393b24</entry>
Apr 11 19:22:49 user nova-compute[82196]:       <entry name="uuid">dde6b4d2-9288-474c-b400-ce3b6f393b24</entry>
Apr 11 19:22:49 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:22:49 user nova-compute[82196]:     </system>
Apr 11 19:22:49 user nova-compute[82196]:   </sysinfo>
Apr 11 19:22:49 user nova-compute[82196]:   <os>
Apr 11 19:22:49 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:22:49 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:22:49 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:22:49 user nova-compute[82196]:   </os>
Apr 11 19:22:49 user nova-compute[82196]:   <features>
Apr 11 19:22:49 user nova-compute[82196]:     <acpi/>
Apr 11 19:22:49 user nova-compute[82196]:     <apic/>
Apr 11 19:22:49 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:22:49 user nova-compute[82196]:   </features>
Apr 11 19:22:49 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:22:49 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:22:49 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:22:49 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:22:49 user nova-compute[82196]:   </clock>
Apr 11 19:22:49 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:22:49 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:22:49 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:22:49 user nova-compute[82196]:   </cpu>
Apr 11 19:22:49 user nova-compute[82196]:   <devices>
Apr 11 19:22:49 user nova-compute[82196]:     <disk type="file" device="cdrom">
Apr 11 19:22:49 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 19:22:49 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/dde6b4d2-9288-474c-b400-ce3b6f393b24/disk.config"/>
Apr 11 19:22:49 user nova-compute[82196]:       <target dev="hda" bus="ide"/>
Apr 11 19:22:49 user nova-compute[82196]:     </disk>
Apr 11 19:22:49 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:22:49 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:22:49 user nova-compute[82196]:       <source dev="/dev/sdb"/>
Apr 11 19:22:49 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:22:49 user nova-compute[82196]:       <serial>a38d7c75-168f-480e-8f42-0c2606086f09</serial>
Apr 11 19:22:49 user nova-compute[82196]:     </disk>
Apr 11 19:22:49 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:22:49 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:22:49 user nova-compute[82196]:       <source dev="/dev/sdc"/>
Apr 11 19:22:49 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:22:49 user nova-compute[82196]:       <serial>125a0bcb-5bbf-4fa8-81f5-f9054a4a2235</serial>
Apr 11 19:22:49 user nova-compute[82196]:     </disk>
Apr 11 19:22:49 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:22:49 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:22:49 user nova-compute[82196]:       <source dev="/dev/sdd"/>
Apr 11 19:22:49 user nova-compute[82196]:       <target dev="vdc" bus="virtio"/>
Apr 11 19:22:49 user nova-compute[82196]:       <serial>0b6fb879-bd91-4f68-a952-095dadc5eaef</serial>
Apr 11 19:22:49 user nova-compute[82196]:     </disk>
Apr 11 19:22:49 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:49 user nova-compute[82196]:       <mac address="fa:16:3e:df:00:78"/>
Apr 11 19:22:49 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:49 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:49 user nova-compute[82196]:       <target dev="tapaeb74c01-d9"/>
Apr 11 19:22:49 user nova-compute[82196]:     </interface>
Apr 11 19:22:49 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:49 user nova-compute[82196]:       <mac address="fa:16:3e:23:4b:bd"/>
Apr 11 19:22:49 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:49 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:49 user nova-compute[82196]:       <target dev="tap4768cc5b-e7"/>
Apr 11 19:22:49 user nova-compute[82196]:     </interface>
Apr 11 19:22:49 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:49 user nova-compute[82196]:       <mac address="fa:16:3e:23:66:df"/>
Apr 11 19:22:49 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:49 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:49 user nova-compute[82196]:       <target dev="tap1d14016e-af"/>
Apr 11 19:22:49 user nova-compute[82196]:     </interface>
Apr 11 19:22:49 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:49 user nova-compute[82196]:       <mac address="fa:16:3e:cf:18:6e"/>
Apr 11 19:22:49 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:49 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:49 user nova-compute[82196]:       <target dev="tap576d5a47-cb"/>
Apr 11 19:22:49 user nova-compute[82196]:     </interface>
Apr 11 19:22:49 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:49 user nova-compute[82196]:       <mac address="fa:16:3e:c5:a4:70"/>
Apr 11 19:22:49 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:49 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:49 user nova-compute[82196]:       <target dev="tapdb299c0f-ea"/>
Apr 11 19:22:49 user nova-compute[82196]:     </interface>
Apr 11 19:22:49 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:49 user nova-compute[82196]:       <mac address="fa:16:3e:56:3b:f1"/>
Apr 11 19:22:49 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:49 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:49 user nova-compute[82196]:       <target dev="tap66cd1e83-c7"/>
Apr 11 19:22:49 user nova-compute[82196]:     </interface>
Apr 11 19:22:49 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:49 user nova-compute[82196]:       <mac address="fa:16:3e:1a:59:78"/>
Apr 11 19:22:49 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:49 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:49 user nova-compute[82196]:       <target dev="tap7e8c8382-c8"/>
Apr 11 19:22:49 user nova-compute[82196]:     </interface>
Apr 11 19:22:49 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:22:49 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/dde6b4d2-9288-474c-b400-ce3b6f393b24/console.log" append="off"/>
Apr 11 19:22:49 user nova-compute[82196]:     </serial>
Apr 11 19:22:49 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:22:49 user nova-compute[82196]:     <video>
Apr 11 19:22:49 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:49 user nova-compute[82196]:     </video>
Apr 11 19:22:49 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:22:49 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:22:49 user nova-compute[82196]:     </rng>
Apr 11 19:22:49 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:22:49 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:22:49 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:22:49 user nova-compute[82196]:     </memballoon>
Apr 11 19:22:49 user nova-compute[82196]:   </devices>
Apr 11 19:22:49 user nova-compute[82196]: </domain>
Apr 11 19:22:49 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:00:78,bridge_name='br-int',has_traffic_filtering=True,id=aeb74c01-d96e-4838-8d2c-c2499e3f8770,network=Network(17e7d3c3-aefe-4aac-82cb-be854d82b261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb74c01-d9') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:00:78,bridge_name='br-int',has_traffic_filtering=True,id=aeb74c01-d96e-4838-8d2c-c2499e3f8770,network=Network(17e7d3c3-aefe-4aac-82cb-be854d82b261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb74c01-d9') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaeb74c01-d9, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaeb74c01-d9, col_values=(('external_ids', {'iface-id': 'aeb74c01-d96e-4838-8d2c-c2499e3f8770', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:00:78', 'vm-uuid': 'dde6b4d2-9288-474c-b400-ce3b6f393b24'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: INFO os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:00:78,bridge_name='br-int',has_traffic_filtering=True,id=aeb74c01-d96e-4838-8d2c-c2499e3f8770,network=Network(17e7d3c3-aefe-4aac-82cb-be854d82b261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb74c01-d9')
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=4768cc5b-e792-4c52-805a-7f288ed9fbe5,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4768cc5b-e7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=4768cc5b-e792-4c52-805a-7f288ed9fbe5,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4768cc5b-e7') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4768cc5b-e7, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4768cc5b-e7, col_values=(('external_ids', {'iface-id': '4768cc5b-e792-4c52-805a-7f288ed9fbe5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:4b:bd', 'vm-uuid': 'dde6b4d2-9288-474c-b400-ce3b6f393b24'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.neutron [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: INFO os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=4768cc5b-e792-4c52-805a-7f288ed9fbe5,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4768cc5b-e7')
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:66:df,bridge_name='br-int',has_traffic_filtering=True,id=1d14016e-af6d-4ce8-bd51-8a9dba7c4261,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d14016e-af') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:66:df,bridge_name='br-int',has_traffic_filtering=True,id=1d14016e-af6d-4ce8-bd51-8a9dba7c4261,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d14016e-af') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-de666ca0-acce-4e34-a6d1-2d7a3186037f req-cc5b58b8-96c7-489e-b033-2d6a95615112 service nova] Releasing lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d14016e-af, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d14016e-af, col_values=(('external_ids', {'iface-id': '1d14016e-af6d-4ce8-bd51-8a9dba7c4261', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:66:df', 'vm-uuid': 'dde6b4d2-9288-474c-b400-ce3b6f393b24'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: INFO os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:66:df,bridge_name='br-int',has_traffic_filtering=True,id=1d14016e-af6d-4ce8-bd51-8a9dba7c4261,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d14016e-af')
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=576d5a47-cb3a-4794-bc1e-dcbb82e25352,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576d5a47-cb') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=576d5a47-cb3a-4794-bc1e-dcbb82e25352,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576d5a47-cb') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap576d5a47-cb, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap576d5a47-cb, col_values=(('external_ids', {'iface-id': '576d5a47-cb3a-4794-bc1e-dcbb82e25352', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:18:6e', 'vm-uuid': 'dde6b4d2-9288-474c-b400-ce3b6f393b24'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Successfully updated port: 8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: INFO os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=576d5a47-cb3a-4794-bc1e-dcbb82e25352,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576d5a47-cb')
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a4:70,bridge_name='br-int',has_traffic_filtering=True,id=db299c0f-eae0-45ae-ba9c-037c50e06a3c,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb299c0f-ea') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a4:70,bridge_name='br-int',has_traffic_filtering=True,id=db299c0f-eae0-45ae-ba9c-037c50e06a3c,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb299c0f-ea') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb299c0f-ea, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb299c0f-ea, col_values=(('external_ids', {'iface-id': 'db299c0f-eae0-45ae-ba9c-037c50e06a3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:a4:70', 'vm-uuid': 'dde6b4d2-9288-474c-b400-ce3b6f393b24'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: INFO os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a4:70,bridge_name='br-int',has_traffic_filtering=True,id=db299c0f-eae0-45ae-ba9c-037c50e06a3c,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb299c0f-ea')
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:3b:f1,bridge_name='br-int',has_traffic_filtering=True,id=66cd1e83-c736-444c-84c7-ecfc2c2b3802,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd1e83-c7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:3b:f1,bridge_name='br-int',has_traffic_filtering=True,id=66cd1e83-c736-444c-84c7-ecfc2c2b3802,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd1e83-c7') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66cd1e83-c7, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66cd1e83-c7, col_values=(('external_ids', {'iface-id': '66cd1e83-c736-444c-84c7-ecfc2c2b3802', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:3b:f1', 'vm-uuid': 'dde6b4d2-9288-474c-b400-ce3b6f393b24'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: INFO os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:3b:f1,bridge_name='br-int',has_traffic_filtering=True,id=66cd1e83-c736-444c-84c7-ecfc2c2b3802,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd1e83-c7')
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "address": "fa:16:3e:1a:59:78", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c8382-c8", "ovs_interfaceid": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "address": "fa:16:3e:1a:59:78", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c8382-c8", "ovs_interfaceid": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:78,bridge_name='br-int',has_traffic_filtering=True,id=7e8c8382-c878-4ac7-b626-01cf2bc2f349,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c8382-c8') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:78,bridge_name='br-int',has_traffic_filtering=True,id=7e8c8382-c878-4ac7-b626-01cf2bc2f349,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c8382-c8') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e8c8382-c8, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e8c8382-c8, col_values=(('external_ids', {'iface-id': '7e8c8382-c878-4ac7-b626-01cf2bc2f349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:59:78', 'vm-uuid': 'dde6b4d2-9288-474c-b400-ce3b6f393b24'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:49 user nova-compute[82196]: INFO os_vif [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:78,bridge_name='br-int',has_traffic_filtering=True,id=7e8c8382-c878-4ac7-b626-01cf2bc2f349,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c8382-c8')
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] No BDM found with device name hda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] No VIF found with MAC fa:16:3e:df:00:78, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:22:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] No VIF found with MAC fa:16:3e:c5:a4:70, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:22:49 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Using config drive
Apr 11 19:22:50 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Creating config drive at /opt/stack/data/nova/instances/dde6b4d2-9288-474c-b400-ce3b6f393b24/disk.config
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dde6b4d2-9288-474c-b400-ce3b6f393b24/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppl2q50bo {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:50 user nova-compute[82196]: INFO nova.virt.block_device [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Booting with volume 14117830-bcbb-4cbc-966c-8d7f11cbc013 at /dev/vdc
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dde6b4d2-9288-474c-b400-ce3b6f393b24/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppl2q50bo" returned: 0 in 0.097s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG os_brick.utils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fae301-007c-41a6-9bf6-6fc5cfa10a5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcc3a23-927b-40d7-a4bd-0653bc4f6327]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf22199-b87a-47da-b0a8-df4dfba30492]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[597a1be8-b012-4e10-b326-c13df0357bf2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Successfully updated port: 1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:22:50 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b1586b-ddd1-45bc-b50a-bb17bcb208e5]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG os_brick.utils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating existing volume attachment record: 2f8695ab-a1ec-404c-88b6-f77a83848475 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG nova.compute.manager [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-changed-cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG nova.compute.manager [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing instance network info cache due to event network-changed-cde1df21-a053-49fd-a275-51926ac238e5. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Acquiring lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Acquired lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG nova.network.neutron [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing network info cache for port cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:50 user nova-compute[82196]: DEBUG nova.network.neutron [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.network.neutron [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Releasing lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.compute.manager [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-changed-8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.compute.manager [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing instance network info cache due to event network-changed-8b7ae73d-744e-48fa-af96-b17e7dba1d58. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Acquiring lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Acquired lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.network.neutron [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing network info cache for port 8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Successfully updated port: 6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.network.neutron [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:22:51 user nova-compute[82196]: INFO nova.compute.claims [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Claim successful on node user
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.network.neutron [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Releasing lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.compute.manager [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-changed-1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.compute.manager [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing instance network info cache due to event network-changed-1f5ae163-b670-4418-b5d3-1f0b70fdd991. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Acquiring lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Acquired lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.network.neutron [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing network info cache for port 1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.network.neutron [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.network.neutron [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-37b80ca5-271b-48b4-bbb0-445618f09848 req-ae122dce-87a1-4b1b-901d-583fcf378cc7 service nova] Releasing lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquired lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:22:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.683s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-41184605-0b30-445b-b61b-00bc5b333d83 req-2dd9a906-01a7-46a7-9fbb-8b53e002d350 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-41184605-0b30-445b-b61b-00bc5b333d83 req-2dd9a906-01a7-46a7-9fbb-8b53e002d350 service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-41184605-0b30-445b-b61b-00bc5b333d83 req-2dd9a906-01a7-46a7-9fbb-8b53e002d350 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-41184605-0b30-445b-b61b-00bc5b333d83 req-2dd9a906-01a7-46a7-9fbb-8b53e002d350 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-41184605-0b30-445b-b61b-00bc5b333d83 req-2dd9a906-01a7-46a7-9fbb-8b53e002d350 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:52 user nova-compute[82196]: WARNING nova.compute.manager [req-41184605-0b30-445b-b61b-00bc5b333d83 req-2dd9a906-01a7-46a7-9fbb-8b53e002d350 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-aeb74c01-d96e-4838-8d2c-c2499e3f8770 for instance with vm_state building and task_state spawning.
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:22:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.policy [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a32a5d0547141a180f655e98567ed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bceca6e3506e43f68f9cf8d0b56d141b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:22:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Creating image(s)
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "/opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "/opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "/opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.197s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.159s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk 1073741824" returned: 0 in 0.049s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-changed-6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing instance network info cache due to event network-changed-6503fe71-75d3-4388-9368-0de318a6d614. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] Acquiring lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.179s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:22:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Cannot resize image /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'migration_context' on Instance uuid d424f88d-5f82-4cac-aa0f-4f99624bd3e7 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Ensure instance console log exists: /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Successfully created port: 93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:54 user nova-compute[82196]: WARNING nova.compute.manager [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-aeb74c01-d96e-4838-8d2c-c2499e3f8770 for instance with vm_state building and task_state spawning.
Apr 11 19:22:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:54 user nova-compute[82196]: WARNING nova.compute.manager [req-ddce300e-a0ff-4b8f-a475-3fe831eeee26 req-49f0f98f-b568-4444-aea5-4b06ee2b3118 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-66cd1e83-c736-444c-84c7-ecfc2c2b3802 for instance with vm_state building and task_state spawning.
Apr 11 19:22:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [{"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "address": "fa:16:3e:20:be:ee", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5ae163-b6", "ovs_interfaceid": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6503fe71-75d3-4388-9368-0de318a6d614", "address": "fa:16:3e:a7:f6:07", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6503fe71-75", "ovs_interfaceid": "6503fe71-75d3-4388-9368-0de318a6d614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Releasing lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Instance network_info: |[{"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "address": "fa:16:3e:20:be:ee", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5ae163-b6", "ovs_interfaceid": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6503fe71-75d3-4388-9368-0de318a6d614", "address": "fa:16:3e:a7:f6:07", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6503fe71-75", "ovs_interfaceid": "6503fe71-75d3-4388-9368-0de318a6d614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] Acquired lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing network info cache for port 6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-4768cc5b-e792-4c52-805a-7f288ed9fbe5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-4768cc5b-e792-4c52-805a-7f288ed9fbe5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:55 user nova-compute[82196]: WARNING nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-4768cc5b-e792-4c52-805a-7f288ed9fbe5 for instance with vm_state building and task_state spawning.
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:55 user nova-compute[82196]: WARNING nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 for instance with vm_state building and task_state spawning.
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:55 user nova-compute[82196]: WARNING nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 for instance with vm_state building and task_state spawning.
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:55 user nova-compute[82196]: WARNING nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-576d5a47-cb3a-4794-bc1e-dcbb82e25352 for instance with vm_state building and task_state spawning.
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:55 user nova-compute[82196]: WARNING nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-576d5a47-cb3a-4794-bc1e-dcbb82e25352 for instance with vm_state building and task_state spawning.
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:55 user nova-compute[82196]: WARNING nova.compute.manager [req-5fe10e84-0e6e-4123-b935-8f586d957171 req-9edb750b-e959-459d-8fab-b45dbb1a727d service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-db299c0f-eae0-45ae-ba9c-037c50e06a3c for instance with vm_state building and task_state spawning.
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Successfully updated port: 93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquired lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:22:55 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Creating image(s)
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Ensure instance console log exists: /opt/stack/data/nova/instances/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Start _get_guest_xml network_info=[{"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "address": "fa:16:3e:20:be:ee", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5ae163-b6", "ovs_interfaceid": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6503fe71-75d3-4388-9368-0de318a6d614", "address": "fa:16:3e:a7:f6:07", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6503fe71-75", "ovs_interfaceid": "6503fe71-75d3-4388-9368-0de318a6d614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfVjskwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b', 'attached_at': '', 'detached_at': '', 'volume_id': '6cd6076d-a423-48e8-a9a6-e77019975089', 'serial': '6cd6076d-a423-48e8-a9a6-e77019975089'}, 'attachment_id': '9e941827-96ba-4bde-8409-31dad0700d9b', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxiFeMyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc002f3d-0af6-486e-beea-3bcc54a9a101', 'serial': 'cc002f3d-0af6-486e-beea-3bcc54a9a101'}, 'attachment_id': '3097b7cd-12eb-40e6-ab14-de13649ff7ac', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': 1, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtHVUkvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b', 'attached_at': '', 'detached_at': '', 'volume_id': '14117830-bcbb-4cbc-966c-8d7f11cbc013', 'serial': '14117830-bcbb-4cbc-966c-8d7f11cbc013'}, 'attachment_id': '2f8695ab-a1ec-404c-88b6-f77a83848475', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'boot_index': 2, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:22:55 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:55 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfVjskwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:22:55 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:22:55 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:22:55 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.network.neutron [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updated VIF entry in instance network info cache for port 6503fe71-75d3-4388-9368-0de318a6d614. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.network.neutron [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [{"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "address": "fa:16:3e:20:be:ee", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5ae163-b6", "ovs_interfaceid": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6503fe71-75d3-4388-9368-0de318a6d614", "address": "fa:16:3e:a7:f6:07", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6503fe71-75", "ovs_interfaceid": "6503fe71-75d3-4388-9368-0de318a6d614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8d2608-a34e-4072-9da6-6742ebaa14a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:22:55 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] Releasing lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-4768cc5b-e792-4c52-805a-7f288ed9fbe5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-4768cc5b-e792-4c52-805a-7f288ed9fbe5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:55 user nova-compute[82196]: WARNING nova.compute.manager [req-df654e27-5626-4046-8b1e-63717541735a req-295c6ee9-a62e-4a4e-849e-5c0c3c9f7ca6 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-4768cc5b-e792-4c52-805a-7f288ed9fbe5 for instance with vm_state building and task_state spawning.
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d8cc89-cead-46b1-a57b-ffebfde11945]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089] added
Apr 11 19:22:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9804649f-9dc4-4dfc-9496-88bb073a6ea8]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fbbe34-de52-45c8-a862-955b2d080300]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfVjskwm {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfVjskwm" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a275b2-3345-4cc6-aebc-b03620cca535]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pfVjskwm'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe82ec5-67ca-43c7-9542-197409bbb028]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4d856d-8014-4fce-ad21-1412026359e7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:55 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:55 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:55 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:55 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90f76cb-bcc5-487f-a8b8-214b082b922a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089, portal: 172.16.0.220,3260]
Apr 11 19:22:55 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089, portal: 172.16.0.220,3260] successful.
Apr 11 19:22:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eecdc4-ea80-4683-83c6-58569c5eb227]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[febbf8a8-242b-4e53-81e9-f6f03b14bfd1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:55 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:55 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:55 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:22:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:55 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:55 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:55 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:22:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3966994-331a-451e-b678-3b1b587b4e95]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfVjskwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Updating instance_info_cache with network_info: [{"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Releasing lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Instance network_info: |[{"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Start _get_guest_xml network_info=[{"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:22:55 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:55 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1153080058',display_name='tempest-TestStampPattern-server-1153080058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1153080058',id=12,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk/F931FMuqnj9QLMI+pGBS0j8hrERQZ0hcpFPwqT+C/Srrx02ZenEuPQP/CTs/VLAlwECMwCuedYJB3t1d4C9VnWF3rrxqO6dqYPkLQMKZthDnoCY8H8zWO0Un/+Ismw==',key_name='tempest-TestStampPattern-1385471309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bceca6e3506e43f68f9cf8d0b56d141b',ramdisk_id='',reservation_id='r-t10k1764',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-497408287',owner_user_name='tempest-TestStampPattern-497408287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:52Z,user_data=None,user_id='3a32a5d0547141a180f655e98567ed9a',uuid=d424f88d-5f82-4cac-aa0f-4f99624bd3e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Converting VIF {"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:48:64,bridge_name='br-int',has_traffic_filtering=True,id=93054605-985d-4168-9809-21feb31c1346,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93054605-98') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'pci_devices' on Instance uuid d424f88d-5f82-4cac-aa0f-4f99624bd3e7 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:22:55 user nova-compute[82196]:   <uuid>d424f88d-5f82-4cac-aa0f-4f99624bd3e7</uuid>
Apr 11 19:22:55 user nova-compute[82196]:   <name>instance-0000000c</name>
Apr 11 19:22:55 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:22:55 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:22:55 user nova-compute[82196]:   <metadata>
Apr 11 19:22:55 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:22:55 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:22:55 user nova-compute[82196]:       <nova:name>tempest-TestStampPattern-server-1153080058</nova:name>
Apr 11 19:22:55 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:22:55</nova:creationTime>
Apr 11 19:22:55 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:22:55 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:22:55 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:22:55 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:22:55 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:22:55 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:22:55 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:22:55 user nova-compute[82196]:       <nova:owner>
Apr 11 19:22:55 user nova-compute[82196]:         <nova:user uuid="3a32a5d0547141a180f655e98567ed9a">tempest-TestStampPattern-497408287-project-member</nova:user>
Apr 11 19:22:55 user nova-compute[82196]:         <nova:project uuid="bceca6e3506e43f68f9cf8d0b56d141b">tempest-TestStampPattern-497408287</nova:project>
Apr 11 19:22:55 user nova-compute[82196]:       </nova:owner>
Apr 11 19:22:55 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:22:55 user nova-compute[82196]:       <nova:ports>
Apr 11 19:22:55 user nova-compute[82196]:         <nova:port uuid="93054605-985d-4168-9809-21feb31c1346">
Apr 11 19:22:55 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:22:55 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:55 user nova-compute[82196]:       </nova:ports>
Apr 11 19:22:55 user nova-compute[82196]:     </nova:instance>
Apr 11 19:22:55 user nova-compute[82196]:   </metadata>
Apr 11 19:22:55 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:22:55 user nova-compute[82196]:     <system>
Apr 11 19:22:55 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:22:55 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:22:55 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:22:55 user nova-compute[82196]:       <entry name="serial">d424f88d-5f82-4cac-aa0f-4f99624bd3e7</entry>
Apr 11 19:22:55 user nova-compute[82196]:       <entry name="uuid">d424f88d-5f82-4cac-aa0f-4f99624bd3e7</entry>
Apr 11 19:22:55 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:22:55 user nova-compute[82196]:     </system>
Apr 11 19:22:55 user nova-compute[82196]:   </sysinfo>
Apr 11 19:22:55 user nova-compute[82196]:   <os>
Apr 11 19:22:55 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:22:55 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:22:55 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:22:55 user nova-compute[82196]:   </os>
Apr 11 19:22:55 user nova-compute[82196]:   <features>
Apr 11 19:22:55 user nova-compute[82196]:     <acpi/>
Apr 11 19:22:55 user nova-compute[82196]:     <apic/>
Apr 11 19:22:55 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:22:55 user nova-compute[82196]:   </features>
Apr 11 19:22:55 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:22:55 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:22:55 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:22:55 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:22:55 user nova-compute[82196]:   </clock>
Apr 11 19:22:55 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:22:55 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:22:55 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:22:55 user nova-compute[82196]:   </cpu>
Apr 11 19:22:55 user nova-compute[82196]:   <devices>
Apr 11 19:22:55 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:22:55 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:22:55 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk"/>
Apr 11 19:22:55 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:22:55 user nova-compute[82196]:     </disk>
Apr 11 19:22:55 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:55 user nova-compute[82196]:       <mac address="fa:16:3e:84:48:64"/>
Apr 11 19:22:55 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:55 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:55 user nova-compute[82196]:       <target dev="tap93054605-98"/>
Apr 11 19:22:55 user nova-compute[82196]:     </interface>
Apr 11 19:22:55 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:22:55 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/console.log" append="off"/>
Apr 11 19:22:55 user nova-compute[82196]:     </serial>
Apr 11 19:22:55 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:22:55 user nova-compute[82196]:     <video>
Apr 11 19:22:55 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:55 user nova-compute[82196]:     </video>
Apr 11 19:22:55 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:22:55 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:22:55 user nova-compute[82196]:     </rng>
Apr 11 19:22:55 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:22:55 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:22:55 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:22:55 user nova-compute[82196]:     </memballoon>
Apr 11 19:22:55 user nova-compute[82196]:   </devices>
Apr 11 19:22:55 user nova-compute[82196]: </domain>
Apr 11 19:22:55 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1153080058',display_name='tempest-TestStampPattern-server-1153080058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1153080058',id=12,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk/F931FMuqnj9QLMI+pGBS0j8hrERQZ0hcpFPwqT+C/Srrx02ZenEuPQP/CTs/VLAlwECMwCuedYJB3t1d4C9VnWF3rrxqO6dqYPkLQMKZthDnoCY8H8zWO0Un/+Ismw==',key_name='tempest-TestStampPattern-1385471309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bceca6e3506e43f68f9cf8d0b56d141b',ramdisk_id='',reservation_id='r-t10k1764',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-497408287',owner_user_name='tempest-TestStampPattern-497408287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:52Z,user_data=None,user_id='3a32a5d0547141a180f655e98567ed9a',uuid=d424f88d-5f82-4cac-aa0f-4f99624bd3e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Converting VIF {"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:48:64,bridge_name='br-int',has_traffic_filtering=True,id=93054605-985d-4168-9809-21feb31c1346,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93054605-98') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG os_vif [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:48:64,bridge_name='br-int',has_traffic_filtering=True,id=93054605-985d-4168-9809-21feb31c1346,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93054605-98') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93054605-98, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93054605-98, col_values=(('external_ids', {'iface-id': '93054605-985d-4168-9809-21feb31c1346', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:48:64', 'vm-uuid': 'd424f88d-5f82-4cac-aa0f-4f99624bd3e7'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:56 user nova-compute[82196]: INFO os_vif [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:48:64,bridge_name='br-int',has_traffic_filtering=True,id=93054605-985d-4168-9809-21feb31c1346,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93054605-98')
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-dc7a9d56-07ee-4478-aaff-c353504c55a4 req-4920a599-a958-4e83-a0bc-c9d2e781e5e0 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dc7a9d56-07ee-4478-aaff-c353504c55a4 req-4920a599-a958-4e83-a0bc-c9d2e781e5e0 service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dc7a9d56-07ee-4478-aaff-c353504c55a4 req-4920a599-a958-4e83-a0bc-c9d2e781e5e0 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dc7a9d56-07ee-4478-aaff-c353504c55a4 req-4920a599-a958-4e83-a0bc-c9d2e781e5e0 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-dc7a9d56-07ee-4478-aaff-c353504c55a4 req-4920a599-a958-4e83-a0bc-c9d2e781e5e0 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:56 user nova-compute[82196]: WARNING nova.compute.manager [req-dc7a9d56-07ee-4478-aaff-c353504c55a4 req-4920a599-a958-4e83-a0bc-c9d2e781e5e0 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-66cd1e83-c736-444c-84c7-ecfc2c2b3802 for instance with vm_state building and task_state spawning.
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] No VIF found with MAC fa:16:3e:84:48:64, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240976.3834512, dde6b4d2-9288-474c-b400-ce3b6f393b24 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:56 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] VM Resumed (Lifecycle Event)
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:22:56 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Instance spawned successfully.
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:56 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240976.3890405, dde6b4d2-9288-474c-b400-ce3b6f393b24 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:56 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] VM Started (Lifecycle Event)
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:56 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:56 user nova-compute[82196]: INFO nova.compute.manager [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Took 11.65 seconds to spawn the instance on the hypervisor.
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:56 user nova-compute[82196]: INFO nova.compute.manager [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Took 36.59 seconds to build instance.
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7bd73526-96c4-4492-884f-f570f1651e09 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.722s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23731303930626337', 'path': '/dev/sde'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731303930626337', 'path': '/dev/sde'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxiFeMyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:22:56 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:22:56 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:22:56 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fba8ab-13de-425f-b206-b88284d3b31a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:22:56 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4c29a1-a8c9-4db8-9503-b1c1875773f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101] added
Apr 11 19:22:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8367fafb-f45b-4c6e-ba58-0dbee258364d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6031f2b-807d-4051-86dc-c4631a6f7e80]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxiFeMyt {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxiFeMyt" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3081b08-82bb-4f76-a32a-f92df2464971]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pxiFeMyt'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd46429-2497-4944-828b-294ec5ea0691]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[730ec88a-3673-4fae-9513-9795183ec694]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:56 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:56 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:56 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:22:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:56 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:56 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:56 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:22:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e3ff07-ec07-4769-a0a1-08f534f5a162]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101, portal: 172.16.0.220,3260]
Apr 11 19:22:56 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101, portal: 172.16.0.220,3260] successful.
Apr 11 19:22:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacf0a5c-70dc-4afe-9290-bcca463d1a32]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b5cc5b-e244-4639-99f8-3e2f6fe8ba73]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:57 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:57 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:57 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:22:57 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:22:57 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:57 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:57 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:57 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:22:57 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:22:57 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec32acd8-70ff-441b-864a-bdef6853b851]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxiFeMyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:57 user nova-compute[82196]: WARNING nova.compute.manager [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-db299c0f-eae0-45ae-ba9c-037c50e06a3c for instance with vm_state active and task_state None.
Apr 11 19:22:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Received event network-changed-93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Refreshing instance network info cache due to event network-changed-93054605-985d-4168-9809-21feb31c1346. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Acquiring lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Acquired lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG nova.network.neutron [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Refreshing network info cache for port 93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG nova.network.neutron [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Updated VIF entry in instance network info cache for port 93054605-985d-4168-9809-21feb31c1346. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG nova.network.neutron [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Updating instance_info_cache with network_info: [{"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Releasing lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:57 user nova-compute[82196]: WARNING nova.compute.manager [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-7e8c8382-c878-4ac7-b626-01cf2bc2f349 for instance with vm_state active and task_state None.
Apr 11 19:22:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:57 user nova-compute[82196]: WARNING nova.compute.manager [req-dfd9b4c7-7443-478f-b613-6d104069e820 req-06599f2f-ad81-4dd7-955d-2fdfd96dce64 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-7e8c8382-c878-4ac7-b626-01cf2bc2f349 for instance with vm_state active and task_state None.
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23262666238373030', 'path': '/dev/sdf'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262666238373030', 'path': '/dev/sdf'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtHVUkvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:22:58 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:22:58 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:22:58 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[af97c49b-8b31-4e7a-8f27-0f1fa86ea8e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:22:58 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[057272c3-989e-48fe-abdc-9aef3ec31c83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013] added
Apr 11 19:22:58 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe6c668-d5c1-4725-81fc-ec8ed904aedb]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db0586b-b0f8-4120-bc6b-cf40e73d9215]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtHVUkvN {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtHVUkvN" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[445954c5-cd47-41a2-9f0e-64a1df07c6e0]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gtHVUkvN'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be263bb-0a22-457b-8949-77ab3c6c12ee]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db3e97e-1eb0-4611-ae7a-227c30a72c89]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cc400b-9dcf-4a7c-8d9a-9a893c720270]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013, portal: 172.16.0.220,3260]
Apr 11 19:22:58 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013, portal: 172.16.0.220,3260] successful.
Apr 11 19:22:58 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[372ccaaa-3ee3-4579-8ca7-fe0c04b28494]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c31ad9f-65ed-4212-96ad-d463956bd9dd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:22:58 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22ae43b-62ab-498b-b054-792079863171]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtHVUkvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:22:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Received event network-vif-plugged-93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] Acquiring lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] No waiting events found dispatching network-vif-plugged-93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:59 user nova-compute[82196]: WARNING nova.compute.manager [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Received unexpected event network-vif-plugged-93054605-985d-4168-9809-21feb31c1346 for instance with vm_state building and task_state spawning.
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Received event network-vif-plugged-93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] Acquiring lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] No waiting events found dispatching network-vif-plugged-93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:22:59 user nova-compute[82196]: WARNING nova.compute.manager [req-a3573a88-9f18-45de-9f6d-b5efae3833e6 req-1eedb2b7-281c-4aad-91d2-a08064e4dbcd service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Received unexpected event network-vif-plugged-93054605-985d-4168-9809-21feb31c1346 for instance with vm_state building and task_state spawning.
Apr 11 19:22:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26466636532646237', 'path': '/dev/sdg'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466636532646237', 'path': '/dev/sdg'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a1:3e,bridge_name='br-int',has_traffic_filtering=True,id=59314c6a-6d9a-4586-a8de-27a566e58eb4,network=Network(92d50449-1a92-4c36-9625-7b6d9326a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59314c6a-6d') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b1:87,bridge_name='br-int',has_traffic_filtering=True,id=986b85fe-4d6d-4ac6-95c7-02e58e4073b2,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986b85fe-4d') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=f3db6cdb-4d7d-4c66-a809-d59e3feaea97,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3db6cdb-4d') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=cde1df21-a053-49fd-a275-51926ac238e5,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde1df21-a0') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b7ae73d-744e-48fa-af96-b17e7dba1d58,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ae73d-74') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "address": "fa:16:3e:20:be:ee", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5ae163-b6", "ovs_interfaceid": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "address": "fa:16:3e:20:be:ee", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5ae163-b6", "ovs_interfaceid": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:be:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f5ae163-b670-4418-b5d3-1f0b70fdd991,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5ae163-b6') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6503fe71-75d3-4388-9368-0de318a6d614", "address": "fa:16:3e:a7:f6:07", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6503fe71-75", "ovs_interfaceid": "6503fe71-75d3-4388-9368-0de318a6d614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "6503fe71-75d3-4388-9368-0de318a6d614", "address": "fa:16:3e:a7:f6:07", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6503fe71-75", "ovs_interfaceid": "6503fe71-75d3-4388-9368-0de318a6d614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=6503fe71-75d3-4388-9368-0de318a6d614,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6503fe71-75') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lazy-loading 'pci_devices' on Instance uuid 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:22:59 user nova-compute[82196]:   <uuid>75a4ef96-a6c3-4ccd-9503-bab0d4174b2b</uuid>
Apr 11 19:22:59 user nova-compute[82196]:   <name>instance-0000000b</name>
Apr 11 19:22:59 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:22:59 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:22:59 user nova-compute[82196]:   <metadata>
Apr 11 19:22:59 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:22:59 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:22:59 user nova-compute[82196]:       <nova:name>tempest-device-tagging-server-1561645398</nova:name>
Apr 11 19:22:59 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:22:55</nova:creationTime>
Apr 11 19:22:59 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:22:59 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:22:59 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:22:59 user nova-compute[82196]:       <nova:owner>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:user uuid="bb69b26bc5af47069cdd00b39db75375">tempest-TaggedBootDevicesTest-673790428-project-member</nova:user>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:project uuid="5ac81630b23345679b841ea2c3fe28f6">tempest-TaggedBootDevicesTest-673790428</nova:project>
Apr 11 19:22:59 user nova-compute[82196]:       </nova:owner>
Apr 11 19:22:59 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:22:59 user nova-compute[82196]:       <nova:ports>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:port uuid="59314c6a-6d9a-4586-a8de-27a566e58eb4">
Apr 11 19:22:59 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 19:22:59 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:port uuid="986b85fe-4d6d-4ac6-95c7-02e58e4073b2">
Apr 11 19:22:59 user nova-compute[82196]:           <nova:ip type="fixed" address="10.1.1.218" ipVersion="4"/>
Apr 11 19:22:59 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:port uuid="f3db6cdb-4d7d-4c66-a809-d59e3feaea97">
Apr 11 19:22:59 user nova-compute[82196]:           <nova:ip type="fixed" address="10.1.1.74" ipVersion="4"/>
Apr 11 19:22:59 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:port uuid="cde1df21-a053-49fd-a275-51926ac238e5">
Apr 11 19:22:59 user nova-compute[82196]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Apr 11 19:22:59 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:port uuid="8b7ae73d-744e-48fa-af96-b17e7dba1d58">
Apr 11 19:22:59 user nova-compute[82196]:           <nova:ip type="fixed" address="10.1.1.44" ipVersion="4"/>
Apr 11 19:22:59 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:port uuid="1f5ae163-b670-4418-b5d3-1f0b70fdd991">
Apr 11 19:22:59 user nova-compute[82196]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 19:22:59 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:59 user nova-compute[82196]:         <nova:port uuid="6503fe71-75d3-4388-9368-0de318a6d614">
Apr 11 19:22:59 user nova-compute[82196]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 19:22:59 user nova-compute[82196]:         </nova:port>
Apr 11 19:22:59 user nova-compute[82196]:       </nova:ports>
Apr 11 19:22:59 user nova-compute[82196]:     </nova:instance>
Apr 11 19:22:59 user nova-compute[82196]:   </metadata>
Apr 11 19:22:59 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:22:59 user nova-compute[82196]:     <system>
Apr 11 19:22:59 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:22:59 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:22:59 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:22:59 user nova-compute[82196]:       <entry name="serial">75a4ef96-a6c3-4ccd-9503-bab0d4174b2b</entry>
Apr 11 19:22:59 user nova-compute[82196]:       <entry name="uuid">75a4ef96-a6c3-4ccd-9503-bab0d4174b2b</entry>
Apr 11 19:22:59 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:22:59 user nova-compute[82196]:     </system>
Apr 11 19:22:59 user nova-compute[82196]:   </sysinfo>
Apr 11 19:22:59 user nova-compute[82196]:   <os>
Apr 11 19:22:59 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:22:59 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:22:59 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:22:59 user nova-compute[82196]:   </os>
Apr 11 19:22:59 user nova-compute[82196]:   <features>
Apr 11 19:22:59 user nova-compute[82196]:     <acpi/>
Apr 11 19:22:59 user nova-compute[82196]:     <apic/>
Apr 11 19:22:59 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:22:59 user nova-compute[82196]:   </features>
Apr 11 19:22:59 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:22:59 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:22:59 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:22:59 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:22:59 user nova-compute[82196]:   </clock>
Apr 11 19:22:59 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:22:59 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:22:59 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:22:59 user nova-compute[82196]:   </cpu>
Apr 11 19:22:59 user nova-compute[82196]:   <devices>
Apr 11 19:22:59 user nova-compute[82196]:     <disk type="file" device="cdrom">
Apr 11 19:22:59 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 19:22:59 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b/disk.config"/>
Apr 11 19:22:59 user nova-compute[82196]:       <target dev="hda" bus="ide"/>
Apr 11 19:22:59 user nova-compute[82196]:     </disk>
Apr 11 19:22:59 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:22:59 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:22:59 user nova-compute[82196]:       <source dev="/dev/sde"/>
Apr 11 19:22:59 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:22:59 user nova-compute[82196]:       <serial>6cd6076d-a423-48e8-a9a6-e77019975089</serial>
Apr 11 19:22:59 user nova-compute[82196]:     </disk>
Apr 11 19:22:59 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:22:59 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:22:59 user nova-compute[82196]:       <source dev="/dev/sdf"/>
Apr 11 19:22:59 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:22:59 user nova-compute[82196]:       <serial>cc002f3d-0af6-486e-beea-3bcc54a9a101</serial>
Apr 11 19:22:59 user nova-compute[82196]:     </disk>
Apr 11 19:22:59 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:22:59 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:22:59 user nova-compute[82196]:       <source dev="/dev/sdg"/>
Apr 11 19:22:59 user nova-compute[82196]:       <target dev="vdc" bus="virtio"/>
Apr 11 19:22:59 user nova-compute[82196]:       <serial>14117830-bcbb-4cbc-966c-8d7f11cbc013</serial>
Apr 11 19:22:59 user nova-compute[82196]:     </disk>
Apr 11 19:22:59 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:59 user nova-compute[82196]:       <mac address="fa:16:3e:b3:a1:3e"/>
Apr 11 19:22:59 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:59 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:59 user nova-compute[82196]:       <target dev="tap59314c6a-6d"/>
Apr 11 19:22:59 user nova-compute[82196]:     </interface>
Apr 11 19:22:59 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:59 user nova-compute[82196]:       <mac address="fa:16:3e:ed:b1:87"/>
Apr 11 19:22:59 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:59 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:59 user nova-compute[82196]:       <target dev="tap986b85fe-4d"/>
Apr 11 19:22:59 user nova-compute[82196]:     </interface>
Apr 11 19:22:59 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:59 user nova-compute[82196]:       <mac address="fa:16:3e:3b:99:6a"/>
Apr 11 19:22:59 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:59 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:59 user nova-compute[82196]:       <target dev="tapf3db6cdb-4d"/>
Apr 11 19:22:59 user nova-compute[82196]:     </interface>
Apr 11 19:22:59 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:59 user nova-compute[82196]:       <mac address="fa:16:3e:0f:4d:37"/>
Apr 11 19:22:59 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:59 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:59 user nova-compute[82196]:       <target dev="tapcde1df21-a0"/>
Apr 11 19:22:59 user nova-compute[82196]:     </interface>
Apr 11 19:22:59 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:59 user nova-compute[82196]:       <mac address="fa:16:3e:79:9d:a8"/>
Apr 11 19:22:59 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:59 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:59 user nova-compute[82196]:       <target dev="tap8b7ae73d-74"/>
Apr 11 19:22:59 user nova-compute[82196]:     </interface>
Apr 11 19:22:59 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:59 user nova-compute[82196]:       <mac address="fa:16:3e:20:be:ee"/>
Apr 11 19:22:59 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:59 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:59 user nova-compute[82196]:       <target dev="tap1f5ae163-b6"/>
Apr 11 19:22:59 user nova-compute[82196]:     </interface>
Apr 11 19:22:59 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:22:59 user nova-compute[82196]:       <mac address="fa:16:3e:a7:f6:07"/>
Apr 11 19:22:59 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:59 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:22:59 user nova-compute[82196]:       <target dev="tap6503fe71-75"/>
Apr 11 19:22:59 user nova-compute[82196]:     </interface>
Apr 11 19:22:59 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:22:59 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b/console.log" append="off"/>
Apr 11 19:22:59 user nova-compute[82196]:     </serial>
Apr 11 19:22:59 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:22:59 user nova-compute[82196]:     <video>
Apr 11 19:22:59 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:22:59 user nova-compute[82196]:     </video>
Apr 11 19:22:59 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:22:59 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:22:59 user nova-compute[82196]:     </rng>
Apr 11 19:22:59 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:22:59 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:22:59 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:22:59 user nova-compute[82196]:     </memballoon>
Apr 11 19:22:59 user nova-compute[82196]:   </devices>
Apr 11 19:22:59 user nova-compute[82196]: </domain>
Apr 11 19:22:59 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a1:3e,bridge_name='br-int',has_traffic_filtering=True,id=59314c6a-6d9a-4586-a8de-27a566e58eb4,network=Network(92d50449-1a92-4c36-9625-7b6d9326a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59314c6a-6d') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a1:3e,bridge_name='br-int',has_traffic_filtering=True,id=59314c6a-6d9a-4586-a8de-27a566e58eb4,network=Network(92d50449-1a92-4c36-9625-7b6d9326a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59314c6a-6d') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59314c6a-6d, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59314c6a-6d, col_values=(('external_ids', {'iface-id': '59314c6a-6d9a-4586-a8de-27a566e58eb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:a1:3e', 'vm-uuid': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: INFO os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a1:3e,bridge_name='br-int',has_traffic_filtering=True,id=59314c6a-6d9a-4586-a8de-27a566e58eb4,network=Network(92d50449-1a92-4c36-9625-7b6d9326a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59314c6a-6d')
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b1:87,bridge_name='br-int',has_traffic_filtering=True,id=986b85fe-4d6d-4ac6-95c7-02e58e4073b2,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986b85fe-4d') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b1:87,bridge_name='br-int',has_traffic_filtering=True,id=986b85fe-4d6d-4ac6-95c7-02e58e4073b2,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986b85fe-4d') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap986b85fe-4d, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap986b85fe-4d, col_values=(('external_ids', {'iface-id': '986b85fe-4d6d-4ac6-95c7-02e58e4073b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:b1:87', 'vm-uuid': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: INFO os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b1:87,bridge_name='br-int',has_traffic_filtering=True,id=986b85fe-4d6d-4ac6-95c7-02e58e4073b2,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986b85fe-4d')
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=f3db6cdb-4d7d-4c66-a809-d59e3feaea97,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3db6cdb-4d') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=f3db6cdb-4d7d-4c66-a809-d59e3feaea97,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3db6cdb-4d') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3db6cdb-4d, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3db6cdb-4d, col_values=(('external_ids', {'iface-id': 'f3db6cdb-4d7d-4c66-a809-d59e3feaea97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:99:6a', 'vm-uuid': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: INFO os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=f3db6cdb-4d7d-4c66-a809-d59e3feaea97,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3db6cdb-4d')
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=cde1df21-a053-49fd-a275-51926ac238e5,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde1df21-a0') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=cde1df21-a053-49fd-a275-51926ac238e5,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde1df21-a0') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcde1df21-a0, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcde1df21-a0, col_values=(('external_ids', {'iface-id': 'cde1df21-a053-49fd-a275-51926ac238e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:4d:37', 'vm-uuid': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: INFO os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=cde1df21-a053-49fd-a275-51926ac238e5,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde1df21-a0')
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b7ae73d-744e-48fa-af96-b17e7dba1d58,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ae73d-74') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b7ae73d-744e-48fa-af96-b17e7dba1d58,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ae73d-74') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b7ae73d-74, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b7ae73d-74, col_values=(('external_ids', {'iface-id': '8b7ae73d-744e-48fa-af96-b17e7dba1d58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:9d:a8', 'vm-uuid': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: INFO os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b7ae73d-744e-48fa-af96-b17e7dba1d58,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ae73d-74')
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "address": "fa:16:3e:20:be:ee", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5ae163-b6", "ovs_interfaceid": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "address": "fa:16:3e:20:be:ee", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5ae163-b6", "ovs_interfaceid": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:be:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f5ae163-b670-4418-b5d3-1f0b70fdd991,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5ae163-b6') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:be:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f5ae163-b670-4418-b5d3-1f0b70fdd991,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5ae163-b6') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f5ae163-b6, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f5ae163-b6, col_values=(('external_ids', {'iface-id': '1f5ae163-b670-4418-b5d3-1f0b70fdd991', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:be:ee', 'vm-uuid': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: INFO os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:be:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f5ae163-b670-4418-b5d3-1f0b70fdd991,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5ae163-b6')
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6503fe71-75d3-4388-9368-0de318a6d614", "address": "fa:16:3e:a7:f6:07", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6503fe71-75", "ovs_interfaceid": "6503fe71-75d3-4388-9368-0de318a6d614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "6503fe71-75d3-4388-9368-0de318a6d614", "address": "fa:16:3e:a7:f6:07", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6503fe71-75", "ovs_interfaceid": "6503fe71-75d3-4388-9368-0de318a6d614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=6503fe71-75d3-4388-9368-0de318a6d614,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6503fe71-75') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=6503fe71-75d3-4388-9368-0de318a6d614,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6503fe71-75') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6503fe71-75, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6503fe71-75, col_values=(('external_ids', {'iface-id': '6503fe71-75d3-4388-9368-0de318a6d614', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:f6:07', 'vm-uuid': '75a4ef96-a6c3-4ccd-9503-bab0d4174b2b'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240979.8157365, d424f88d-5f82-4cac-aa0f-4f99624bd3e7 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:59 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] VM Resumed (Lifecycle Event)
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:22:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Instance spawned successfully.
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:22:59 user nova-compute[82196]: INFO os_vif [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=6503fe71-75d3-4388-9368-0de318a6d614,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6503fe71-75')
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:22:59 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240979.8193183, d424f88d-5f82-4cac-aa0f-4f99624bd3e7 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:22:59 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] VM Started (Lifecycle Event)
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:22:59 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] No BDM found with device name hda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] No VIF found with MAC fa:16:3e:b3:a1:3e, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] No VIF found with MAC fa:16:3e:79:9d:a8, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:22:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Using config drive
Apr 11 19:22:59 user nova-compute[82196]: INFO nova.compute.manager [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Took 7.57 seconds to spawn the instance on the hypervisor.
Apr 11 19:22:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:23:00 user nova-compute[82196]: INFO nova.compute.manager [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Took 8.71 seconds to build instance.
Apr 11 19:23:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4a077faa-c9a8-453a-a876-43af5971bfa9 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.821s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:00 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Creating config drive at /opt/stack/data/nova/instances/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b/disk.config
Apr 11 19:23:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprjuu1ryz {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprjuu1ryz" returned: 0 in 0.057s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:01 user nova-compute[82196]: DEBUG nova.compute.manager [req-8937b631-bdd9-4f91-a6cb-53e09916d59a req-2528f8f6-6089-437f-bc14-bc8d36ea2bdd service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8937b631-bdd9-4f91-a6cb-53e09916d59a req-2528f8f6-6089-437f-bc14-bc8d36ea2bdd service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8937b631-bdd9-4f91-a6cb-53e09916d59a req-2528f8f6-6089-437f-bc14-bc8d36ea2bdd service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8937b631-bdd9-4f91-a6cb-53e09916d59a req-2528f8f6-6089-437f-bc14-bc8d36ea2bdd service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:01 user nova-compute[82196]: DEBUG nova.compute.manager [req-8937b631-bdd9-4f91-a6cb-53e09916d59a req-2528f8f6-6089-437f-bc14-bc8d36ea2bdd service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:01 user nova-compute[82196]: WARNING nova.compute.manager [req-8937b631-bdd9-4f91-a6cb-53e09916d59a req-2528f8f6-6089-437f-bc14-bc8d36ea2bdd service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-59314c6a-6d9a-4586-a8de-27a566e58eb4 for instance with vm_state building and task_state spawning.
Apr 11 19:23:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-31371170-fcfb-434a-97a4-ada65984a1f6 req-a84963d9-bfd4-4e0a-b648-7d261c8c8bc3 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-31371170-fcfb-434a-97a4-ada65984a1f6 req-a84963d9-bfd4-4e0a-b648-7d261c8c8bc3 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-31371170-fcfb-434a-97a4-ada65984a1f6 req-a84963d9-bfd4-4e0a-b648-7d261c8c8bc3 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-31371170-fcfb-434a-97a4-ada65984a1f6 req-a84963d9-bfd4-4e0a-b648-7d261c8c8bc3 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-31371170-fcfb-434a-97a4-ada65984a1f6 req-a84963d9-bfd4-4e0a-b648-7d261c8c8bc3 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:02 user nova-compute[82196]: WARNING nova.compute.manager [req-31371170-fcfb-434a-97a4-ada65984a1f6 req-a84963d9-bfd4-4e0a-b648-7d261c8c8bc3 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 for instance with vm_state building and task_state spawning.
Apr 11 19:23:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:04 user nova-compute[82196]: WARNING nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-59314c6a-6d9a-4586-a8de-27a566e58eb4 for instance with vm_state building and task_state spawning.
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:04 user nova-compute[82196]: WARNING nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 for instance with vm_state building and task_state spawning.
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:04 user nova-compute[82196]: WARNING nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 for instance with vm_state building and task_state spawning.
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:04 user nova-compute[82196]: WARNING nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-cde1df21-a053-49fd-a275-51926ac238e5 for instance with vm_state building and task_state spawning.
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:04 user nova-compute[82196]: WARNING nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-cde1df21-a053-49fd-a275-51926ac238e5 for instance with vm_state building and task_state spawning.
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:04 user nova-compute[82196]: WARNING nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-8b7ae73d-744e-48fa-af96-b17e7dba1d58 for instance with vm_state building and task_state spawning.
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:04 user nova-compute[82196]: WARNING nova.compute.manager [req-b2732c92-c89a-41f5-a637-c1808c6f8670 req-b90558c1-6a43-4706-905e-674227bfa56b service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-8b7ae73d-744e-48fa-af96-b17e7dba1d58 for instance with vm_state building and task_state spawning.
Apr 11 19:23:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:04 user nova-compute[82196]: WARNING nova.compute.manager [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 for instance with vm_state building and task_state spawning.
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:04 user nova-compute[82196]: WARNING nova.compute.manager [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-1f5ae163-b670-4418-b5d3-1f0b70fdd991 for instance with vm_state building and task_state spawning.
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:04 user nova-compute[82196]: WARNING nova.compute.manager [req-89fe84cd-7dfe-4373-9a76-3c9dba616950 req-e6623d22-6794-46e8-8c4a-d67ea8ffc14d service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-1f5ae163-b670-4418-b5d3-1f0b70fdd991 for instance with vm_state building and task_state spawning.
Apr 11 19:23:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:05 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240985.9690375, 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:23:05 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] VM Resumed (Lifecycle Event)
Apr 11 19:23:05 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:23:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:23:05 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Instance spawned successfully.
Apr 11 19:23:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:06 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681240985.9735768, 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:23:06 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] VM Started (Lifecycle Event)
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:23:06 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:23:06 user nova-compute[82196]: INFO nova.compute.manager [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Took 10.86 seconds to spawn the instance on the hypervisor.
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:06 user nova-compute[82196]: WARNING nova.compute.manager [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-6503fe71-75d3-4388-9368-0de318a6d614 for instance with vm_state building and task_state spawning.
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:06 user nova-compute[82196]: WARNING nova.compute.manager [req-2be813db-5b9a-4537-ae97-e68346204210 req-5ae47cb3-8c90-402b-97ca-2939981ce3d1 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-6503fe71-75d3-4388-9368-0de318a6d614 for instance with vm_state building and task_state spawning.
Apr 11 19:23:06 user nova-compute[82196]: INFO nova.compute.manager [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Took 30.60 seconds to build instance.
Apr 11 19:23:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6805afdb-ebe5-4f42-b05d-c74f67d33b06 tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.768s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:23:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:28 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:23:28 user nova-compute[82196]: INFO nova.compute.claims [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Claim successful on node user
Apr 11 19:23:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG nova.network.neutron [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:23:29 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:23:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG nova.policy [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f44dfa2528b4540a81f4eb7c3f3f2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5d7769df1e4974b295cb30407151dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:23:29 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Creating image(s)
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "/opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "/opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "/opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.164s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG nova.objects.instance [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lazy-loading 'flavor' on Instance uuid efd7afec-d6d0-4e3f-a3b9-f672b3e711cf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.161s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk 1073741824" returned: 0 in 0.047s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.150s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:30 user nova-compute[82196]: INFO nova.compute.manager [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Attaching volume 0616446d-3e4d-4ae8-8ed2-d95b5082eeca to /dev/vdb
Apr 11 19:23:30 user nova-compute[82196]: DEBUG nova.network.neutron [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Successfully created port: 27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG os_brick.utils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1406a6-e007-4ba4-8e71-9875a77d257d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Cannot resize image /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG nova.objects.instance [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lazy-loading 'migration_context' on Instance uuid e84ad0e4-a65b-404c-adbf-c49d5f0b3cca {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4d0a78-cb60-466e-85c0-ea9daf12d7e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Ensure instance console log exists: /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0926f595-ca9b-4d84-82ac-726199139c84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c36506-77fb-468e-a5f1-518509aaa12b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:23:30 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc259a0-1ed1-499f-b604-d1704df83cae]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG os_brick.utils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Updating existing volume attachment record: 056cf97b-3045-4fc6-9d2f-c45eb4dd7a3c {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG nova.network.neutron [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Successfully updated port: 27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "refresh_cache-e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquired lock "refresh_cache-e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG nova.network.neutron [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG nova.compute.manager [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Received event network-changed-27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG nova.compute.manager [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Refreshing instance network info cache due to event network-changed-27172120-33d2-4fbe-9af2-e8376499f9bc. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] Acquiring lock "refresh_cache-e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:23:30 user nova-compute[82196]: DEBUG nova.network.neutron [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.network.neutron [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Updating instance_info_cache with network_info: [{"id": "27172120-33d2-4fbe-9af2-e8376499f9bc", "address": "fa:16:3e:40:73:39", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27172120-33", "ovs_interfaceid": "27172120-33d2-4fbe-9af2-e8376499f9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Releasing lock "refresh_cache-e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.compute.manager [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Instance network_info: |[{"id": "27172120-33d2-4fbe-9af2-e8376499f9bc", "address": "fa:16:3e:40:73:39", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27172120-33", "ovs_interfaceid": "27172120-33d2-4fbe-9af2-e8376499f9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] Acquired lock "refresh_cache-e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.network.neutron [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Refreshing network info cache for port 27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Start _get_guest_xml network_info=[{"id": "27172120-33d2-4fbe-9af2-e8376499f9bc", "address": "fa:16:3e:40:73:39", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27172120-33", "ovs_interfaceid": "27172120-33d2-4fbe-9af2-e8376499f9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:23:31 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:23:31 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-246020648',display_name='tempest-ServersNegativeTestJSON-server-246020648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-246020648',id=13,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d5d7769df1e4974b295cb30407151dd',ramdisk_id='',reservation_id='r-db76um4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1311045721',owner_user_name='tempest-ServersNegativeTestJSON-1311045721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:23:29Z,user_data=None,user_id='2f44dfa2528b4540a81f4eb7c3f3f2f5',uuid=e84ad0e4-a65b-404c-adbf-c49d5f0b3cca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27172120-33d2-4fbe-9af2-e8376499f9bc", "address": "fa:16:3e:40:73:39", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27172120-33", "ovs_interfaceid": "27172120-33d2-4fbe-9af2-e8376499f9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Converting VIF {"id": "27172120-33d2-4fbe-9af2-e8376499f9bc", "address": "fa:16:3e:40:73:39", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27172120-33", "ovs_interfaceid": "27172120-33d2-4fbe-9af2-e8376499f9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:73:39,bridge_name='br-int',has_traffic_filtering=True,id=27172120-33d2-4fbe-9af2-e8376499f9bc,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27172120-33') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.objects.instance [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lazy-loading 'pci_devices' on Instance uuid e84ad0e4-a65b-404c-adbf-c49d5f0b3cca {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:23:31 user nova-compute[82196]:   <uuid>e84ad0e4-a65b-404c-adbf-c49d5f0b3cca</uuid>
Apr 11 19:23:31 user nova-compute[82196]:   <name>instance-0000000d</name>
Apr 11 19:23:31 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:23:31 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:23:31 user nova-compute[82196]:   <metadata>
Apr 11 19:23:31 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:23:31 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:23:31 user nova-compute[82196]:       <nova:name>tempest-ServersNegativeTestJSON-server-246020648</nova:name>
Apr 11 19:23:31 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:23:31</nova:creationTime>
Apr 11 19:23:31 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:23:31 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:23:31 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:23:31 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:23:31 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:23:31 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:23:31 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:23:31 user nova-compute[82196]:       <nova:owner>
Apr 11 19:23:31 user nova-compute[82196]:         <nova:user uuid="2f44dfa2528b4540a81f4eb7c3f3f2f5">tempest-ServersNegativeTestJSON-1311045721-project-member</nova:user>
Apr 11 19:23:31 user nova-compute[82196]:         <nova:project uuid="0d5d7769df1e4974b295cb30407151dd">tempest-ServersNegativeTestJSON-1311045721</nova:project>
Apr 11 19:23:31 user nova-compute[82196]:       </nova:owner>
Apr 11 19:23:31 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:23:31 user nova-compute[82196]:       <nova:ports>
Apr 11 19:23:31 user nova-compute[82196]:         <nova:port uuid="27172120-33d2-4fbe-9af2-e8376499f9bc">
Apr 11 19:23:31 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 19:23:31 user nova-compute[82196]:         </nova:port>
Apr 11 19:23:31 user nova-compute[82196]:       </nova:ports>
Apr 11 19:23:31 user nova-compute[82196]:     </nova:instance>
Apr 11 19:23:31 user nova-compute[82196]:   </metadata>
Apr 11 19:23:31 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:23:31 user nova-compute[82196]:     <system>
Apr 11 19:23:31 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:23:31 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:23:31 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:23:31 user nova-compute[82196]:       <entry name="serial">e84ad0e4-a65b-404c-adbf-c49d5f0b3cca</entry>
Apr 11 19:23:31 user nova-compute[82196]:       <entry name="uuid">e84ad0e4-a65b-404c-adbf-c49d5f0b3cca</entry>
Apr 11 19:23:31 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:23:31 user nova-compute[82196]:     </system>
Apr 11 19:23:31 user nova-compute[82196]:   </sysinfo>
Apr 11 19:23:31 user nova-compute[82196]:   <os>
Apr 11 19:23:31 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:23:31 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:23:31 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:23:31 user nova-compute[82196]:   </os>
Apr 11 19:23:31 user nova-compute[82196]:   <features>
Apr 11 19:23:31 user nova-compute[82196]:     <acpi/>
Apr 11 19:23:31 user nova-compute[82196]:     <apic/>
Apr 11 19:23:31 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:23:31 user nova-compute[82196]:   </features>
Apr 11 19:23:31 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:23:31 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:23:31 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:23:31 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:23:31 user nova-compute[82196]:   </clock>
Apr 11 19:23:31 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:23:31 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:23:31 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:23:31 user nova-compute[82196]:   </cpu>
Apr 11 19:23:31 user nova-compute[82196]:   <devices>
Apr 11 19:23:31 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:23:31 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:23:31 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk"/>
Apr 11 19:23:31 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:23:31 user nova-compute[82196]:     </disk>
Apr 11 19:23:31 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:23:31 user nova-compute[82196]:       <mac address="fa:16:3e:40:73:39"/>
Apr 11 19:23:31 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:23:31 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:23:31 user nova-compute[82196]:       <target dev="tap27172120-33"/>
Apr 11 19:23:31 user nova-compute[82196]:     </interface>
Apr 11 19:23:31 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:23:31 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/console.log" append="off"/>
Apr 11 19:23:31 user nova-compute[82196]:     </serial>
Apr 11 19:23:31 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:23:31 user nova-compute[82196]:     <video>
Apr 11 19:23:31 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:23:31 user nova-compute[82196]:     </video>
Apr 11 19:23:31 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:23:31 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:23:31 user nova-compute[82196]:     </rng>
Apr 11 19:23:31 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:23:31 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:23:31 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:23:31 user nova-compute[82196]:     </memballoon>
Apr 11 19:23:31 user nova-compute[82196]:   </devices>
Apr 11 19:23:31 user nova-compute[82196]: </domain>
Apr 11 19:23:31 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-246020648',display_name='tempest-ServersNegativeTestJSON-server-246020648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-246020648',id=13,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d5d7769df1e4974b295cb30407151dd',ramdisk_id='',reservation_id='r-db76um4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1311045721',owner_user_name='tempest-ServersNegativeTestJSON-1311045721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:23:29Z,user_data=None,user_id='2f44dfa2528b4540a81f4eb7c3f3f2f5',uuid=e84ad0e4-a65b-404c-adbf-c49d5f0b3cca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27172120-33d2-4fbe-9af2-e8376499f9bc", "address": "fa:16:3e:40:73:39", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27172120-33", "ovs_interfaceid": "27172120-33d2-4fbe-9af2-e8376499f9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Converting VIF {"id": "27172120-33d2-4fbe-9af2-e8376499f9bc", "address": "fa:16:3e:40:73:39", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27172120-33", "ovs_interfaceid": "27172120-33d2-4fbe-9af2-e8376499f9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:73:39,bridge_name='br-int',has_traffic_filtering=True,id=27172120-33d2-4fbe-9af2-e8376499f9bc,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27172120-33') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG os_vif [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:73:39,bridge_name='br-int',has_traffic_filtering=True,id=27172120-33d2-4fbe-9af2-e8376499f9bc,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27172120-33') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27172120-33, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27172120-33, col_values=(('external_ids', {'iface-id': '27172120-33d2-4fbe-9af2-e8376499f9bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:73:39', 'vm-uuid': 'e84ad0e4-a65b-404c-adbf-c49d5f0b3cca'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:31 user nova-compute[82196]: INFO os_vif [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:73:39,bridge_name='br-int',has_traffic_filtering=True,id=27172120-33d2-4fbe-9af2-e8376499f9bc,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27172120-33')
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] No VIF found with MAC fa:16:3e:40:73:39, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.network.neutron [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Updated VIF entry in instance network info cache for port 27172120-33d2-4fbe-9af2-e8376499f9bc. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG nova.network.neutron [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Updating instance_info_cache with network_info: [{"id": "27172120-33d2-4fbe-9af2-e8376499f9bc", "address": "fa:16:3e:40:73:39", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27172120-33", "ovs_interfaceid": "27172120-33d2-4fbe-9af2-e8376499f9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:23:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8ee547bd-7430-465f-a808-46c3e1152713 req-e55f5184-759f-46ad-8a96-bd26b304a37f service nova] Releasing lock "refresh_cache-e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:23:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-cc7e1288-1e97-4f38-b68a-381e4fa15a58 req-6c02fcd3-1ed3-4188-93b9-62230241b863 service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Received event network-vif-plugged-27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-cc7e1288-1e97-4f38-b68a-381e4fa15a58 req-6c02fcd3-1ed3-4188-93b9-62230241b863 service nova] Acquiring lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-cc7e1288-1e97-4f38-b68a-381e4fa15a58 req-6c02fcd3-1ed3-4188-93b9-62230241b863 service nova] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-cc7e1288-1e97-4f38-b68a-381e4fa15a58 req-6c02fcd3-1ed3-4188-93b9-62230241b863 service nova] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-cc7e1288-1e97-4f38-b68a-381e4fa15a58 req-6c02fcd3-1ed3-4188-93b9-62230241b863 service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] No waiting events found dispatching network-vif-plugged-27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:32 user nova-compute[82196]: WARNING nova.compute.manager [req-cc7e1288-1e97-4f38-b68a-381e4fa15a58 req-6c02fcd3-1ed3-4188-93b9-62230241b863 service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Received unexpected event network-vif-plugged-27172120-33d2-4fbe-9af2-e8376499f9bc for instance with vm_state building and task_state spawning.
Apr 11 19:23:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcDlxmMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:23:34 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:23:34 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:23:34 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d94c0e3-2c18-4127-bab2-3f5bb8886962]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:23:34 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2172227-7f41-4719-80c6-dea1c0f7a255]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca] added
Apr 11 19:23:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fe0dbd-702b-453a-bb15-15051d46bc90]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1415bc-8112-40f2-8ef6-251398b45c72]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kcDlxmMr {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kcDlxmMr" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a162d9c-fbc7-4074-b339-7d146c590b6f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kcDlxmMr'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2194d229-6ec0-4b8e-81bb-7b6c5553db88]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c425ce-5c46-430c-98f5-5a45f3e7a9ea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68649a8-d0b0-44ef-9d02-f71a6ce062bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca, portal: 172.16.0.220,3260]
Apr 11 19:23:34 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca, portal: 172.16.0.220,3260] successful.
Apr 11 19:23:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2e8505-2e3f-499e-8c9f-80f81a0f8301]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4de6b4-6961-4f20-b2a9-2e28960319f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca (non-flash)
Apr 11 19:23:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:23:34 user nova-compute[82196]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca (non-flash)
Apr 11 19:23:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.065s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9007cf-8842-4a5f-a638-107dba75129f]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcDlxmMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241014.9708169, e84ad0e4-a65b-404c-adbf-c49d5f0b3cca => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:23:34 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] VM Resumed (Lifecycle Event)
Apr 11 19:23:34 user nova-compute[82196]: DEBUG nova.compute.manager [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:23:34 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Instance spawned successfully.
Apr 11 19:23:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:23:34 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.compute.manager [req-ab55e306-7997-41df-b614-3242713f7851 req-c25a723c-a7b6-4f91-b22e-983f763513c0 service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Received event network-vif-plugged-27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ab55e306-7997-41df-b614-3242713f7851 req-c25a723c-a7b6-4f91-b22e-983f763513c0 service nova] Acquiring lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ab55e306-7997-41df-b614-3242713f7851 req-c25a723c-a7b6-4f91-b22e-983f763513c0 service nova] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ab55e306-7997-41df-b614-3242713f7851 req-c25a723c-a7b6-4f91-b22e-983f763513c0 service nova] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.compute.manager [req-ab55e306-7997-41df-b614-3242713f7851 req-c25a723c-a7b6-4f91-b22e-983f763513c0 service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] No waiting events found dispatching network-vif-plugged-27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:35 user nova-compute[82196]: WARNING nova.compute.manager [req-ab55e306-7997-41df-b614-3242713f7851 req-c25a723c-a7b6-4f91-b22e-983f763513c0 service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Received unexpected event network-vif-plugged-27172120-33d2-4fbe-9af2-e8376499f9bc for instance with vm_state building and task_state spawning.
Apr 11 19:23:35 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241014.975158, e84ad0e4-a65b-404c-adbf-c49d5f0b3cca => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:23:35 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] VM Started (Lifecycle Event)
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:23:35 user nova-compute[82196]: INFO nova.compute.manager [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Took 5.54 seconds to spawn the instance on the hypervisor.
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:23:35 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:23:35 user nova-compute[82196]: INFO nova.compute.manager [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Took 6.32 seconds to build instance.
Apr 11 19:23:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-76b1b874-4358-4979-a5f3-93ca5317e21c tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.431s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23333306639656235', 'path': '/dev/sdh'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333306639656235', 'path': '/dev/sdh'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:23:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lazy-loading 'flavor' on Instance uuid efd7afec-d6d0-4e3f-a3b9-f672b3e711cf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:23:36 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:23:36 user nova-compute[82196]:   <source dev="/dev/sdh"/>
Apr 11 19:23:36 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:23:36 user nova-compute[82196]:   <serial>0616446d-3e4d-4ae8-8ed2-d95b5082eeca</serial>
Apr 11 19:23:36 user nova-compute[82196]: </disk>
Apr 11 19:23:36 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] No VIF found with MAC fa:16:3e:6a:84:54, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:23:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f68d161b-b519-42a3-b783-3623c67aba0f tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.561s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.compute.manager [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Received event network-changed-b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.compute.manager [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Refreshing instance network info cache due to event network-changed-b644e09b-afb0-43e7-9773-0df435010320. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] Acquiring lock "refresh_cache-bed4001c-02c2-4c6b-84c8-61654df66d8b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] Acquired lock "refresh_cache-bed4001c-02c2-4c6b-84c8-61654df66d8b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.network.neutron [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Refreshing network info cache for port b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Updating instance_info_cache with network_info: [{"id": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "address": "fa:16:3e:6a:84:54", "network": {"id": "ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-452666997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34322e02b2fc4c2c84fb77583faf4405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096d6451-04", "ovs_interfaceid": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.network.neutron [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Updated VIF entry in instance network info cache for port b644e09b-afb0-43e7-9773-0df435010320. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.network.neutron [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Updating instance_info_cache with network_info: [{"id": "b644e09b-afb0-43e7-9773-0df435010320", "address": "fa:16:3e:16:ad:8e", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb644e09b-af", "ovs_interfaceid": "b644e09b-afb0-43e7-9773-0df435010320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e316c09b-5e04-4b6f-a413-4e94ef8b186f req-6a4823f6-d614-4df2-a1c7-60a21298ec4d service nova] Releasing lock "refresh_cache-bed4001c-02c2-4c6b-84c8-61654df66d8b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:37 user nova-compute[82196]: INFO nova.compute.manager [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Terminating instance
Apr 11 19:23:37 user nova-compute[82196]: DEBUG nova.compute.manager [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-2dd73dde-5c1b-49e5-82fb-072230e6f223 req-8a8aa386-3e4c-401c-a7e5-542b9843c80d service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Received event network-vif-unplugged-096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2dd73dde-5c1b-49e5-82fb-072230e6f223 req-8a8aa386-3e4c-401c-a7e5-542b9843c80d service nova] Acquiring lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2dd73dde-5c1b-49e5-82fb-072230e6f223 req-8a8aa386-3e4c-401c-a7e5-542b9843c80d service nova] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2dd73dde-5c1b-49e5-82fb-072230e6f223 req-8a8aa386-3e4c-401c-a7e5-542b9843c80d service nova] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-2dd73dde-5c1b-49e5-82fb-072230e6f223 req-8a8aa386-3e4c-401c-a7e5-542b9843c80d service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] No waiting events found dispatching network-vif-unplugged-096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-2dd73dde-5c1b-49e5-82fb-072230e6f223 req-8a8aa386-3e4c-401c-a7e5-542b9843c80d service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Received event network-vif-unplugged-096d6451-049b-4ff5-9eaf-8ee3884c8715 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG nova.objects.instance [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'flavor' on Instance uuid bed4001c-02c2-4c6b-84c8-61654df66d8b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.144s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:38 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Instance destroyed successfully.
Apr 11 19:23:38 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lazy-loading 'resources' on Instance uuid efd7afec-d6d0-4e3f-a3b9-f672b3e711cf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1799394439',display_name='tempest-DeleteServersTestJSON-server-1799394439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1799394439',id=2,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:21:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34322e02b2fc4c2c84fb77583faf4405',ramdisk_id='',reservation_id='r-ohtxvv2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-124461992',owner_user_name='tempest-DeleteServersTestJSON-124461992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:21:54Z,user_data=None,user_id='502b859ece744cf680123cd4e9643938',uuid=efd7afec-d6d0-4e3f-a3b9-f672b3e711cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "address": "fa:16:3e:6a:84:54", "network": {"id": "ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-452666997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34322e02b2fc4c2c84fb77583faf4405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096d6451-04", "ovs_interfaceid": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Converting VIF {"id": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "address": "fa:16:3e:6a:84:54", "network": {"id": "ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-452666997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34322e02b2fc4c2c84fb77583faf4405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096d6451-04", "ovs_interfaceid": "096d6451-049b-4ff5-9eaf-8ee3884c8715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:84:54,bridge_name='br-int',has_traffic_filtering=True,id=096d6451-049b-4ff5-9eaf-8ee3884c8715,network=Network(ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096d6451-04') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG os_vif [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:84:54,bridge_name='br-int',has_traffic_filtering=True,id=096d6451-049b-4ff5-9eaf-8ee3884c8715,network=Network(ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096d6451-04') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap096d6451-04, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:23:38 user nova-compute[82196]: INFO os_vif [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:84:54,bridge_name='br-int',has_traffic_filtering=True,id=096d6451-049b-4ff5-9eaf-8ee3884c8715,network=Network(ebd8b9a8-4546-4cc1-bf7c-f1c141dc58dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096d6451-04')
Apr 11 19:23:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcDlxmMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:23:38 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:23:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5856f106-5ecb-4339-9907-fce985789a56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:23:38 user nova-compute[82196]: No targets found.
Apr 11 19:23:38 user nova-compute[82196]: iSNS:
Apr 11 19:23:38 user nova-compute[82196]: No targets found.
Apr 11 19:23:38 user nova-compute[82196]: STATIC:
Apr 11 19:23:38 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09
Apr 11 19:23:38 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:23:38 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:23:38 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca
Apr 11 19:23:38 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:23:38 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:23:38 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef
Apr 11 19:23:38 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:23:38 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:23:38 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235
Apr 11 19:23:38 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:23:38 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:23:38 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101
Apr 11 19:23:38 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:23:38 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:23:38 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089
Apr 11 19:23:38 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:23:38 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:23:38 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013
Apr 11 19:23:38 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:23:38 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:23:38 user nova-compute[82196]: FIRMWARE:
Apr 11 19:23:38 user nova-compute[82196]: No targets found.
Apr 11 19:23:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:23:38 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:23:38 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ed0b52-6ec2-4257-bbc1-c8c3a31d2dc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:38 user nova-compute[82196]: INFO nova.compute.manager [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Attaching volume 4940d74f-b60a-49aa-bf74-4e000efa8dc5 to /dev/vdb
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3fd56e-3163-4e6d-b407-27d4fc92d3cd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:23:38 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:23:38 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:23:38 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:23:38 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:23:38 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:23:38 user nova-compute[82196]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca (non-flash)
Apr 11 19:23:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:23:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:23:38 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:23:38 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:23:38 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:23:38 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:23:38 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:23:38 user nova-compute[82196]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca (non-flash)
Apr 11 19:23:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9281a89a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca'): ({'sdh'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Removing single pathed devices sdh {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9180f43-a9b4-4f9a-ba6d-618220ecd21c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.utils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc4f68e-28bf-47b8-93da-70280acabd11]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Flushing IO for device /dev/sdh {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[286136c0-9e5a-43d0-b658-2454bdc8d33e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[25397bee-a4f7-41fe-aa85-7e79c08423dd]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e452acc7-f2af-455d-b7ed-04e1033b94dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8729d5e9-7e1b-491c-b54b-987fd7917b51]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] SCSI volumes sdh have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1067adc-d83e-492f-8635-b20e2604494c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4116a3ed-27b3-4f1e-81f3-4952ad01ec02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd28ed6b-df42-4a58-89dd-8b6752d4e64e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:23:39 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde2e3fc-46fe-43fc-8083-f6b8b53c4e1f]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.utils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Updating existing volume attachment record: 7e3742cd-e590-4163-adce-8c957d9f7bd6 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b31e17-5147-4d1a-8b2f-196465fa9b52]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca, portal: 172.16.0.220,3260]
Apr 11 19:23:39 user nova-compute[82196]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca, portal: 172.16.0.220,3260] successful.
Apr 11 19:23:39 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0616446d-3e4d-4ae8-8ed2-d95b5082eeca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c817efee-17e0-4feb-b6ac-e715bfad163f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.482s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] <== disconnect_volume: return (485ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:23:39 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Deleting instance files /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf_del
Apr 11 19:23:39 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Deletion of /opt/stack/data/nova/instances/efd7afec-d6d0-4e3f-a3b9-f672b3e711cf_del complete
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Checking UEFI support for host arch (x86_64) {{(pid=82196) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 11 19:23:39 user nova-compute[82196]: INFO nova.virt.libvirt.host [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] UEFI support detected
Apr 11 19:23:39 user nova-compute[82196]: INFO nova.compute.manager [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Took 1.61 seconds to destroy the instance on the hypervisor.
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:23:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:23:40 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Took 0.93 seconds to deallocate network for instance.
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG nova.compute.manager [req-f0f6d6b9-45a0-4dc2-8b2a-586b74cf8c6b req-2e98269b-b08b-489b-babb-0ea3f0f8dca4 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Received event network-vif-plugged-096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f0f6d6b9-45a0-4dc2-8b2a-586b74cf8c6b req-2e98269b-b08b-489b-babb-0ea3f0f8dca4 service nova] Acquiring lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f0f6d6b9-45a0-4dc2-8b2a-586b74cf8c6b req-2e98269b-b08b-489b-babb-0ea3f0f8dca4 service nova] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f0f6d6b9-45a0-4dc2-8b2a-586b74cf8c6b req-2e98269b-b08b-489b-babb-0ea3f0f8dca4 service nova] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG nova.compute.manager [req-f0f6d6b9-45a0-4dc2-8b2a-586b74cf8c6b req-2e98269b-b08b-489b-babb-0ea3f0f8dca4 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] No waiting events found dispatching network-vif-plugged-096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:40 user nova-compute[82196]: WARNING nova.compute.manager [req-f0f6d6b9-45a0-4dc2-8b2a-586b74cf8c6b req-2e98269b-b08b-489b-babb-0ea3f0f8dca4 service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Received unexpected event network-vif-plugged-096d6451-049b-4ff5-9eaf-8ee3884c8715 for instance with vm_state active and task_state deleting.
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:42 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:23:42 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7143MB free_disk=26.591087341308594GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.manager [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-changed-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.manager [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Refreshing instance network info cache due to event network-changed-5a15e207-1839-4be5-80b2-fc995098dbbf. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] Acquiring lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] Acquired lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.network.neutron [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Refreshing network info cache for port 5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bed4001c-02c2-4c6b-84c8-61654df66d8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 8e449d09-f632-4f57-b304-430734096596 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance a49d379e-3976-4d68-b6df-f572a922107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9941d033-15c2-4069-b9a6-f80840e95a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance b71d95ed-728d-4386-b7c6-50b252718ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 1ded3918-3bae-465c-a53c-e88011914c50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.manager [req-5801e098-0a15-466f-b22d-5b293cefaf3f req-05c72e9e-2228-4859-8ed3-9af3237b9cde service nova] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Received event network-vif-deleted-096d6451-049b-4ff5-9eaf-8ee3884c8715 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.network.neutron [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updated VIF entry in instance network info cache for port 5a15e207-1839-4be5-80b2-fc995098dbbf. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.network.neutron [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updating instance_info_cache with network_info: [{"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.762s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3b00c87b-2211-4252-8f09-603ffebf29e3 req-5af33c0f-d961-4040-9b22-9e6b5a5e0e55 service nova] Releasing lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:23:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:23:43 user nova-compute[82196]: INFO nova.compute.manager [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] instance snapshotting
Apr 11 19:23:43 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Beginning live snapshot process
Apr 11 19:23:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json -f qcow2 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json -f qcow2 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json -f qcow2" returned: 0 in 0.166s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: INFO nova.compute.manager [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Took 3.89 seconds to detach 1 volumes for instance.
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.149s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoa5lw97s/41666576185147878836a817f966bdd4.delta 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoa5lw97s/41666576185147878836a817f966bdd4.delta 1073741824" returned: 0 in 0.079s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 19:23:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htgdusmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:23:44 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:23:44 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:23:44 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55c2ff6-1d90-416a-bcd9-18b7d52b85a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:23:44 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a2cc9c-e529-4973-9a3c-1edd670701d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5] added
Apr 11 19:23:44 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a91ac47-fdec-41e8-ac77-ba3729629c93]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057830f-4fb0-444b-9be4-b861b77ea6fc]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v htgdusmD {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v htgdusmD" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad29fd47-9516-4fbc-a9ee-2276bf233164]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'htgdusmD'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9025a1f6-f0b9-4afe-b21e-3fda3e6c9272]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0d7ca8-a032-446a-b322-f95185d74f77]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fe6771-2ecb-45ba-af2e-0da525bea698]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5, portal: 172.16.0.220,3260]
Apr 11 19:23:44 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5, portal: 172.16.0.220,3260] successful.
Apr 11 19:23:44 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2aa8f7-c9cb-458d-85b2-5e039ede7c2c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7dc019-3b43-40a6-b685-3e30c2009e45]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:23:44 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9b4f9e-afba-44f7-a23a-cfa543a1ef46]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htgdusmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:23:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:44 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Deleted allocations for instance efd7afec-d6d0-4e3f-a3b9-f672b3e711cf
Apr 11 19:23:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b259b826-0379-483e-8c36-c0391c16e925 tempest-DeleteServersTestJSON-124461992 tempest-DeleteServersTestJSON-124461992-project-member] Lock "efd7afec-d6d0-4e3f-a3b9-f672b3e711cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.246s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:23:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:23:45 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 19:23:45 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:23:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoa5lw97s/41666576185147878836a817f966bdd4.delta /opt/stack/data/nova/instances/snapshots/tmpoa5lw97s/41666576185147878836a817f966bdd4 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:23:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26237303561313833', 'path': '/dev/sdh'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:23:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237303561313833', 'path': '/dev/sdh'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:23:45 user nova-compute[82196]: DEBUG nova.objects.instance [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'flavor' on Instance uuid bed4001c-02c2-4c6b-84c8-61654df66d8b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:23:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoa5lw97s/41666576185147878836a817f966bdd4.delta /opt/stack/data/nova/instances/snapshots/tmpoa5lw97s/41666576185147878836a817f966bdd4" returned: 0 in 0.218s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:45 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Snapshot extracted, beginning image upload
Apr 11 19:23:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:23:45 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:23:45 user nova-compute[82196]:   <source dev="/dev/sdh"/>
Apr 11 19:23:45 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:23:45 user nova-compute[82196]:   <serial>4940d74f-b60a-49aa-bf74-4e000efa8dc5</serial>
Apr 11 19:23:45 user nova-compute[82196]: </disk>
Apr 11 19:23:45 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:23:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:23:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:23:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No VIF found with MAC fa:16:3e:16:ad:8e, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:23:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-273f849c-675e-4b9a-9e0a-1dda1636bf7a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.654s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:48 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Snapshot image upload complete
Apr 11 19:23:48 user nova-compute[82196]: INFO nova.compute.manager [None req-bb2ec0e0-d089-4450-82a3-4f6f0c4c62a5 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Took 5.15 seconds to snapshot the instance on the hypervisor.
Apr 11 19:23:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "53ccc829-6323-48ec-b63f-9de9bc607456" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "53ccc829-6323-48ec-b63f-9de9bc607456" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:23:50 user nova-compute[82196]: INFO nova.compute.claims [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Claim successful on node user
Apr 11 19:23:50 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG nova.network.neutron [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:23:50 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:23:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG nova.policy [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:23:50 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Creating image(s)
Apr 11 19:23:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "/opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "/opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "/opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk 1073741824" returned: 0 in 0.053s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Successfully created port: dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Cannot resize image /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG nova.objects.instance [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'migration_context' on Instance uuid 53ccc829-6323-48ec-b63f-9de9bc607456 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Ensure instance console log exists: /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Successfully updated port: dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "refresh_cache-53ccc829-6323-48ec-b63f-9de9bc607456" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquired lock "refresh_cache-53ccc829-6323-48ec-b63f-9de9bc607456" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Received event network-changed-dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Refreshing instance network info cache due to event network-changed-dfba7f5a-ea64-4504-8547-47f354d6a6ef. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] Acquiring lock "refresh_cache-53ccc829-6323-48ec-b63f-9de9bc607456" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Updating instance_info_cache with network_info: [{"id": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "address": "fa:16:3e:91:89:c6", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfba7f5a-ea", "ovs_interfaceid": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Releasing lock "refresh_cache-53ccc829-6323-48ec-b63f-9de9bc607456" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Instance network_info: |[{"id": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "address": "fa:16:3e:91:89:c6", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfba7f5a-ea", "ovs_interfaceid": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] Acquired lock "refresh_cache-53ccc829-6323-48ec-b63f-9de9bc607456" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.network.neutron [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Refreshing network info cache for port dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Start _get_guest_xml network_info=[{"id": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "address": "fa:16:3e:91:89:c6", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfba7f5a-ea", "ovs_interfaceid": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:23:52 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:23:52 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:23:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-953463719',display_name='tempest-AttachVolumeNegativeTest-server-953463719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-953463719',id=14,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMHXuZwHHLTnbwoXHlgW9zf8bL7zVpVkgemb7OvTI/oU7VrYb4dENt1Gx29wnClpENAL4bXzn2wWqsFi41+TNpH3ExAk1aECdr1t7t6sLObcWObhGaOVQ3v0wbmGz14ZA==',key_name='tempest-keypair-985453267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06966e2f4d3a4dec92282c7ad348635d',ramdisk_id='',reservation_id='r-ni3ktelu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-303418642',owner_user_name='tempest-AttachVolumeNegativeTest-303418642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:23:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d405421ceb4d99967ef2e7f55e7809',uuid=53ccc829-6323-48ec-b63f-9de9bc607456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "address": "fa:16:3e:91:89:c6", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfba7f5a-ea", "ovs_interfaceid": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converting VIF {"id": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "address": "fa:16:3e:91:89:c6", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfba7f5a-ea", "ovs_interfaceid": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfba7f5a-ea64-4504-8547-47f354d6a6ef,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfba7f5a-ea') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.objects.instance [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'pci_devices' on Instance uuid 53ccc829-6323-48ec-b63f-9de9bc607456 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:23:52 user nova-compute[82196]:   <uuid>53ccc829-6323-48ec-b63f-9de9bc607456</uuid>
Apr 11 19:23:52 user nova-compute[82196]:   <name>instance-0000000e</name>
Apr 11 19:23:52 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:23:52 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:23:52 user nova-compute[82196]:   <metadata>
Apr 11 19:23:52 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:23:52 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:23:52 user nova-compute[82196]:       <nova:name>tempest-AttachVolumeNegativeTest-server-953463719</nova:name>
Apr 11 19:23:52 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:23:52</nova:creationTime>
Apr 11 19:23:52 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:23:52 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:23:52 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:23:52 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:23:52 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:23:52 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:23:52 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:23:52 user nova-compute[82196]:       <nova:owner>
Apr 11 19:23:52 user nova-compute[82196]:         <nova:user uuid="d5d405421ceb4d99967ef2e7f55e7809">tempest-AttachVolumeNegativeTest-303418642-project-member</nova:user>
Apr 11 19:23:52 user nova-compute[82196]:         <nova:project uuid="06966e2f4d3a4dec92282c7ad348635d">tempest-AttachVolumeNegativeTest-303418642</nova:project>
Apr 11 19:23:52 user nova-compute[82196]:       </nova:owner>
Apr 11 19:23:52 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:23:52 user nova-compute[82196]:       <nova:ports>
Apr 11 19:23:52 user nova-compute[82196]:         <nova:port uuid="dfba7f5a-ea64-4504-8547-47f354d6a6ef">
Apr 11 19:23:52 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 19:23:52 user nova-compute[82196]:         </nova:port>
Apr 11 19:23:52 user nova-compute[82196]:       </nova:ports>
Apr 11 19:23:52 user nova-compute[82196]:     </nova:instance>
Apr 11 19:23:52 user nova-compute[82196]:   </metadata>
Apr 11 19:23:52 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:23:52 user nova-compute[82196]:     <system>
Apr 11 19:23:52 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:23:52 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:23:52 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:23:52 user nova-compute[82196]:       <entry name="serial">53ccc829-6323-48ec-b63f-9de9bc607456</entry>
Apr 11 19:23:52 user nova-compute[82196]:       <entry name="uuid">53ccc829-6323-48ec-b63f-9de9bc607456</entry>
Apr 11 19:23:52 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:23:52 user nova-compute[82196]:     </system>
Apr 11 19:23:52 user nova-compute[82196]:   </sysinfo>
Apr 11 19:23:52 user nova-compute[82196]:   <os>
Apr 11 19:23:52 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:23:52 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:23:52 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:23:52 user nova-compute[82196]:   </os>
Apr 11 19:23:52 user nova-compute[82196]:   <features>
Apr 11 19:23:52 user nova-compute[82196]:     <acpi/>
Apr 11 19:23:52 user nova-compute[82196]:     <apic/>
Apr 11 19:23:52 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:23:52 user nova-compute[82196]:   </features>
Apr 11 19:23:52 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:23:52 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:23:52 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:23:52 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:23:52 user nova-compute[82196]:   </clock>
Apr 11 19:23:52 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:23:52 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:23:52 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:23:52 user nova-compute[82196]:   </cpu>
Apr 11 19:23:52 user nova-compute[82196]:   <devices>
Apr 11 19:23:52 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:23:52 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:23:52 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk"/>
Apr 11 19:23:52 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:23:52 user nova-compute[82196]:     </disk>
Apr 11 19:23:52 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:23:52 user nova-compute[82196]:       <mac address="fa:16:3e:91:89:c6"/>
Apr 11 19:23:52 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:23:52 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:23:52 user nova-compute[82196]:       <target dev="tapdfba7f5a-ea"/>
Apr 11 19:23:52 user nova-compute[82196]:     </interface>
Apr 11 19:23:52 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:23:52 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/console.log" append="off"/>
Apr 11 19:23:52 user nova-compute[82196]:     </serial>
Apr 11 19:23:52 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:23:52 user nova-compute[82196]:     <video>
Apr 11 19:23:52 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:23:52 user nova-compute[82196]:     </video>
Apr 11 19:23:52 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:23:52 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:23:52 user nova-compute[82196]:     </rng>
Apr 11 19:23:52 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:23:52 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:23:52 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:23:52 user nova-compute[82196]:     </memballoon>
Apr 11 19:23:52 user nova-compute[82196]:   </devices>
Apr 11 19:23:52 user nova-compute[82196]: </domain>
Apr 11 19:23:52 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:23:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-953463719',display_name='tempest-AttachVolumeNegativeTest-server-953463719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-953463719',id=14,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMHXuZwHHLTnbwoXHlgW9zf8bL7zVpVkgemb7OvTI/oU7VrYb4dENt1Gx29wnClpENAL4bXzn2wWqsFi41+TNpH3ExAk1aECdr1t7t6sLObcWObhGaOVQ3v0wbmGz14ZA==',key_name='tempest-keypair-985453267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06966e2f4d3a4dec92282c7ad348635d',ramdisk_id='',reservation_id='r-ni3ktelu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-303418642',owner_user_name='tempest-AttachVolumeNegativeTest-303418642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:23:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d405421ceb4d99967ef2e7f55e7809',uuid=53ccc829-6323-48ec-b63f-9de9bc607456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "address": "fa:16:3e:91:89:c6", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfba7f5a-ea", "ovs_interfaceid": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converting VIF {"id": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "address": "fa:16:3e:91:89:c6", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfba7f5a-ea", "ovs_interfaceid": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfba7f5a-ea64-4504-8547-47f354d6a6ef,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfba7f5a-ea') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG os_vif [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfba7f5a-ea64-4504-8547-47f354d6a6ef,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfba7f5a-ea') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfba7f5a-ea, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfba7f5a-ea, col_values=(('external_ids', {'iface-id': 'dfba7f5a-ea64-4504-8547-47f354d6a6ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:89:c6', 'vm-uuid': '53ccc829-6323-48ec-b63f-9de9bc607456'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:52 user nova-compute[82196]: INFO os_vif [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfba7f5a-ea64-4504-8547-47f354d6a6ef,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfba7f5a-ea')
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No VIF found with MAC fa:16:3e:91:89:c6, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.network.neutron [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Updated VIF entry in instance network info cache for port dfba7f5a-ea64-4504-8547-47f354d6a6ef. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG nova.network.neutron [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Updating instance_info_cache with network_info: [{"id": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "address": "fa:16:3e:91:89:c6", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfba7f5a-ea", "ovs_interfaceid": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:23:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-cecc6141-11c0-4c81-9566-35866c826053 req-bc8c6874-c52d-4dcb-b7b2-efd46224d807 service nova] Releasing lock "refresh_cache-53ccc829-6323-48ec-b63f-9de9bc607456" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:23:53 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241018.7500176, efd7afec-d6d0-4e3f-a3b9-f672b3e711cf => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:23:53 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] VM Stopped (Lifecycle Event)
Apr 11 19:23:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d2613bc6-a423-47d9-be47-bf90a3596d5f None None] [instance: efd7afec-d6d0-4e3f-a3b9-f672b3e711cf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:23:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-af8a9c1e-bbc2-4c13-a67b-394c204dcdf1 req-ba7dbd10-2f9b-4edb-b58f-e4d639ee35cb service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Received event network-vif-plugged-dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af8a9c1e-bbc2-4c13-a67b-394c204dcdf1 req-ba7dbd10-2f9b-4edb-b58f-e4d639ee35cb service nova] Acquiring lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af8a9c1e-bbc2-4c13-a67b-394c204dcdf1 req-ba7dbd10-2f9b-4edb-b58f-e4d639ee35cb service nova] Lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af8a9c1e-bbc2-4c13-a67b-394c204dcdf1 req-ba7dbd10-2f9b-4edb-b58f-e4d639ee35cb service nova] Lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-af8a9c1e-bbc2-4c13-a67b-394c204dcdf1 req-ba7dbd10-2f9b-4edb-b58f-e4d639ee35cb service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] No waiting events found dispatching network-vif-plugged-dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:54 user nova-compute[82196]: WARNING nova.compute.manager [req-af8a9c1e-bbc2-4c13-a67b-394c204dcdf1 req-ba7dbd10-2f9b-4edb-b58f-e4d639ee35cb service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Received unexpected event network-vif-plugged-dfba7f5a-ea64-4504-8547-47f354d6a6ef for instance with vm_state building and task_state spawning.
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241036.07627, 53ccc829-6323-48ec-b63f-9de9bc607456 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:23:56 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] VM Resumed (Lifecycle Event)
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:23:56 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Instance spawned successfully.
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:23:56 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241036.0775235, 53ccc829-6323-48ec-b63f-9de9bc607456 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:23:56 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] VM Started (Lifecycle Event)
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:23:56 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:23:56 user nova-compute[82196]: INFO nova.compute.manager [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Took 5.30 seconds to spawn the instance on the hypervisor.
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:23:56 user nova-compute[82196]: INFO nova.compute.manager [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Took 6.14 seconds to build instance.
Apr 11 19:23:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-99ebef90-3713-4e46-8627-912aa99b2023 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "53ccc829-6323-48ec-b63f-9de9bc607456" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.232s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-3e1c06e9-b8c7-4579-9d42-6547eb66c5da req-ce88be34-751d-4922-9d66-3db3d4e34b31 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Received event network-vif-plugged-dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3e1c06e9-b8c7-4579-9d42-6547eb66c5da req-ce88be34-751d-4922-9d66-3db3d4e34b31 service nova] Acquiring lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3e1c06e9-b8c7-4579-9d42-6547eb66c5da req-ce88be34-751d-4922-9d66-3db3d4e34b31 service nova] Lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3e1c06e9-b8c7-4579-9d42-6547eb66c5da req-ce88be34-751d-4922-9d66-3db3d4e34b31 service nova] Lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:23:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-3e1c06e9-b8c7-4579-9d42-6547eb66c5da req-ce88be34-751d-4922-9d66-3db3d4e34b31 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] No waiting events found dispatching network-vif-plugged-dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:23:56 user nova-compute[82196]: WARNING nova.compute.manager [req-3e1c06e9-b8c7-4579-9d42-6547eb66c5da req-ce88be34-751d-4922-9d66-3db3d4e34b31 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Received unexpected event network-vif-plugged-dfba7f5a-ea64-4504-8547-47f354d6a6ef for instance with vm_state active and task_state None.
Apr 11 19:23:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:23:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Received event network-changed-8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Refreshing instance network info cache due to event network-changed-8f590426-373c-4a90-8829-a2ad1a61fcd7. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:24:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] Acquiring lock "refresh_cache-1ded3918-3bae-465c-a53c-e88011914c50" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] Acquired lock "refresh_cache-1ded3918-3bae-465c-a53c-e88011914c50" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:05 user nova-compute[82196]: DEBUG nova.network.neutron [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Refreshing network info cache for port 8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:24:05 user nova-compute[82196]: DEBUG nova.network.neutron [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Updated VIF entry in instance network info cache for port 8f590426-373c-4a90-8829-a2ad1a61fcd7. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:24:05 user nova-compute[82196]: DEBUG nova.network.neutron [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Updating instance_info_cache with network_info: [{"id": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "address": "fa:16:3e:67:5d:8a", "network": {"id": "a4f38bbd-d96e-48df-855f-7eff4d122089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1765637160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c6f64ecc104480a149bcfd0610dfef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f590426-37", "ovs_interfaceid": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f57dce0f-c8fe-49d9-b473-b0dd94103bb8 req-ac16e513-ca86-48f9-8ccf-e3f9c2076d31 service nova] Releasing lock "refresh_cache-1ded3918-3bae-465c-a53c-e88011914c50" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Received event network-changed-936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Refreshing instance network info cache due to event network-changed-936e8263-dbb3-4e76-8f6d-0e3269dc6066. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] Acquiring lock "refresh_cache-a49d379e-3976-4d68-b6df-f572a922107c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] Acquired lock "refresh_cache-a49d379e-3976-4d68-b6df-f572a922107c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG nova.network.neutron [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Refreshing network info cache for port 936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a49d379e-3976-4d68-b6df-f572a922107c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a49d379e-3976-4d68-b6df-f572a922107c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lazy-loading 'flavor' on Instance uuid a49d379e-3976-4d68-b6df-f572a922107c {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "1ded3918-3bae-465c-a53c-e88011914c50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "1ded3918-3bae-465c-a53c-e88011914c50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG nova.objects.instance [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lazy-loading 'flavor' on Instance uuid 1ded3918-3bae-465c-a53c-e88011914c50 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a49d379e-3976-4d68-b6df-f572a922107c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "1ded3918-3bae-465c-a53c-e88011914c50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a49d379e-3976-4d68-b6df-f572a922107c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a49d379e-3976-4d68-b6df-f572a922107c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:06 user nova-compute[82196]: INFO nova.compute.manager [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Attaching volume 51e97579-56cc-414f-9a25-3a7c7d045694 to /dev/vdb
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "1ded3918-3bae-465c-a53c-e88011914c50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "1ded3918-3bae-465c-a53c-e88011914c50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:06 user nova-compute[82196]: INFO nova.compute.manager [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Attaching volume d7bac8da-a912-4a54-b7d8-a012f3ff9c79 to /dev/sdc
Apr 11 19:24:06 user nova-compute[82196]: DEBUG os_brick.utils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[986cee17-5e1f-4699-98da-df1f6428db85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG os_brick.utils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG nova.network.neutron [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Updated VIF entry in instance network info cache for port 936e8263-dbb3-4e76-8f6d-0e3269dc6066. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG nova.network.neutron [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Updating instance_info_cache with network_info: [{"id": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "address": "fa:16:3e:bf:52:8c", "network": {"id": "f46874c2-3c80-4650-be3d-22d674b93195", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1165457224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f8ee2edca748e0bd03ace6f93be649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap936e8263-db", "ovs_interfaceid": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8b82f2-127c-45c5-bfba-1ccd3293ead4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e5eb1b83-a98e-4ffb-b84d-4fa761061bbe req-8449595d-f76f-4d80-9621-3a161dd602fa service nova] Releasing lock "refresh_cache-a49d379e-3976-4d68-b6df-f572a922107c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dca00a5-798e-4da5-834f-ff127029e765]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30f8397-b8bb-4428-b322-98f084154159]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8459c841-2e9a-43a8-968b-05150669e75e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac75536-49ed-4f51-b1c0-8f58122e98ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[067ee5b0-44a2-4844-a666-3783dec583e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62a09f2-0377-4a78-913a-104910df8d35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:06 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb4e75e-a38f-4ac8-b75e-3377c34bcbe8]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG os_brick.utils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Updating existing volume attachment record: 39cc163f-ce25-4a0c-8b51-ceda33dbbb3a {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:24:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:07 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:24:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7bf108-c60f-4dbf-97f1-fdde19e04c67]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG os_brick.utils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Updating existing volume attachment record: 045d2ddb-eba7-4272-8064-6494ce2e20ef {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG nova.compute.manager [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Received event network-changed-031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG nova.compute.manager [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Refreshing instance network info cache due to event network-changed-031df3cc-5433-459d-ab9b-484629289e90. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] Acquiring lock "refresh_cache-9941d033-15c2-4069-b9a6-f80840e95a38" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] Acquired lock "refresh_cache-9941d033-15c2-4069-b9a6-f80840e95a38" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG nova.network.neutron [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Refreshing network info cache for port 031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:24:07 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:08 user nova-compute[82196]: DEBUG nova.network.neutron [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Updated VIF entry in instance network info cache for port 031df3cc-5433-459d-ab9b-484629289e90. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:24:08 user nova-compute[82196]: DEBUG nova.network.neutron [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Updating instance_info_cache with network_info: [{"id": "031df3cc-5433-459d-ab9b-484629289e90", "address": "fa:16:3e:b6:4d:98", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031df3cc-54", "ovs_interfaceid": "031df3cc-5433-459d-ab9b-484629289e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6ef8e0c5-ee2d-46fe-b9b9-f5f547c33bd4 req-b5630e9d-035b-4fa0-9869-fa8d6a08c3dc service nova] Releasing lock "refresh_cache-9941d033-15c2-4069-b9a6-f80840e95a38" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "9941d033-15c2-4069-b9a6-f80840e95a38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "9941d033-15c2-4069-b9a6-f80840e95a38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG nova.objects.instance [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lazy-loading 'flavor' on Instance uuid 9941d033-15c2-4069-b9a6-f80840e95a38 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "9941d033-15c2-4069-b9a6-f80840e95a38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "9941d033-15c2-4069-b9a6-f80840e95a38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "9941d033-15c2-4069-b9a6-f80840e95a38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:09 user nova-compute[82196]: INFO nova.compute.manager [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Attaching volume 447d1208-42c3-46ec-b882-104ae99ab8fe to /dev/vdb
Apr 11 19:24:09 user nova-compute[82196]: DEBUG os_brick.utils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11bfb48-7827-4db9-9c84-7beceff4b309]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2830e2e-c329-4c6f-b8a0-16b56ed4d57a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c466791-cb77-4fcb-ac0c-c33b3fce5195]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1d985b-f23b-4e64-9176-78c71c4dad4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:09 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:24:09 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0acf858-e251-4ddb-b203-d21aeb31ae4d]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG os_brick.utils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:09 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Updating existing volume attachment record: 78e84679-21c2-4f3d-ad76-345008c817d4 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:24:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-changed-aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing instance network info cache due to event network-changed-aeb74c01-d96e-4838-8d2c-c2499e3f8770. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:24:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] Acquiring lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] Acquired lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Refreshing network info cache for port aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:24:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updated VIF entry in instance network info cache for port aeb74c01-d96e-4838-8d2c-c2499e3f8770. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:24:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [{"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "address": "fa:16:3e:1a:59:78", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c8382-c8", "ovs_interfaceid": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1e1ccd08-5631-41f9-98b1-1cdd05c4a769 req-37b37669-3d34-4141-890c-e54410c4a539 service nova] Releasing lock "refresh_cache-dde6b4d2-9288-474c-b400-ce3b6f393b24" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received event network-changed-64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Refreshing instance network info cache due to event network-changed-64bd141d-04e6-46e6-bb46-e997d3234fa1. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] Acquiring lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] Acquired lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG nova.network.neutron [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Refreshing network info cache for port 64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "interface-b71d95ed-728d-4386-b7c6-50b252718ca9-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "interface-b71d95ed-728d-4386-b7c6-50b252718ca9-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG nova.objects.instance [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lazy-loading 'flavor' on Instance uuid b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG nova.objects.instance [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lazy-loading 'pci_requests' on Instance uuid b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG nova.network.neutron [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Updated VIF entry in instance network info cache for port 64bd141d-04e6-46e6-bb46-e997d3234fa1. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG nova.network.neutron [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Updating instance_info_cache with network_info: [{"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f50f05e5-b3a1-4894-af92-99a728174aca req-5b93b50f-f1a1-49c4-8e05-02cdc61bc352 service nova] Releasing lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG nova.policy [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f84e7cbdf6a4e588753fea907beba0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39e7fdf571442b0a6f136020a99f7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:11 user nova-compute[82196]: INFO nova.compute.manager [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Terminating instance
Apr 11 19:24:11 user nova-compute[82196]: DEBUG nova.compute.manager [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG nova.network.neutron [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Successfully created port: 8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-3b5f6418-bf6b-4426-9cd4-382625d98ba5 req-7f56ae4b-91af-44a0-ab65-57e8aaa0a721 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-4768cc5b-e792-4c52-805a-7f288ed9fbe5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3b5f6418-bf6b-4426-9cd4-382625d98ba5 req-7f56ae4b-91af-44a0-ab65-57e8aaa0a721 service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3b5f6418-bf6b-4426-9cd4-382625d98ba5 req-7f56ae4b-91af-44a0-ab65-57e8aaa0a721 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3b5f6418-bf6b-4426-9cd4-382625d98ba5 req-7f56ae4b-91af-44a0-ab65-57e8aaa0a721 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-3b5f6418-bf6b-4426-9cd4-382625d98ba5 req-7f56ae4b-91af-44a0-ab65-57e8aaa0a721 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-unplugged-4768cc5b-e792-4c52-805a-7f288ed9fbe5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-3b5f6418-bf6b-4426-9cd4-382625d98ba5 req-7f56ae4b-91af-44a0-ab65-57e8aaa0a721 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-4768cc5b-e792-4c52-805a-7f288ed9fbe5 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-unplugged-aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-aeb74c01-d96e-4838-8d2c-c2499e3f8770 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:13 user nova-compute[82196]: WARNING nova.compute.manager [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-aeb74c01-d96e-4838-8d2c-c2499e3f8770 for instance with vm_state active and task_state deleting.
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-unplugged-66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-6470592f-3594-494b-961e-dd582069b666 req-25f52be0-02b4-4480-b03a-c97e3f09aa2a service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-66cd1e83-c736-444c-84c7-ecfc2c2b3802 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.network.neutron [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Successfully updated port: 8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquired lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.network.neutron [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received event network-changed-8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Refreshing instance network info cache due to event network-changed-8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] Acquiring lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:13 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Instance destroyed successfully.
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.objects.instance [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lazy-loading 'resources' on Instance uuid dde6b4d2-9288-474c-b400-ce3b6f393b24 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:00:78,bridge_name='br-int',has_traffic_filtering=True,id=aeb74c01-d96e-4838-8d2c-c2499e3f8770,network=Network(17e7d3c3-aefe-4aac-82cb-be854d82b261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb74c01-d9') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:00:78,bridge_name='br-int',has_traffic_filtering=True,id=aeb74c01-d96e-4838-8d2c-c2499e3f8770,network=Network(17e7d3c3-aefe-4aac-82cb-be854d82b261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb74c01-d9') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaeb74c01-d9, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:13 user nova-compute[82196]: INFO os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:00:78,bridge_name='br-int',has_traffic_filtering=True,id=aeb74c01-d96e-4838-8d2c-c2499e3f8770,network=Network(17e7d3c3-aefe-4aac-82cb-be854d82b261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb74c01-d9')
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=4768cc5b-e792-4c52-805a-7f288ed9fbe5,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4768cc5b-e7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=4768cc5b-e792-4c52-805a-7f288ed9fbe5,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4768cc5b-e7') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4768cc5b-e7, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: INFO os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=4768cc5b-e792-4c52-805a-7f288ed9fbe5,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4768cc5b-e7')
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:66:df,bridge_name='br-int',has_traffic_filtering=True,id=1d14016e-af6d-4ce8-bd51-8a9dba7c4261,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d14016e-af') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:66:df,bridge_name='br-int',has_traffic_filtering=True,id=1d14016e-af6d-4ce8-bd51-8a9dba7c4261,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d14016e-af') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d14016e-af, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: INFO os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:66:df,bridge_name='br-int',has_traffic_filtering=True,id=1d14016e-af6d-4ce8-bd51-8a9dba7c4261,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d14016e-af')
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=576d5a47-cb3a-4794-bc1e-dcbb82e25352,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576d5a47-cb') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=576d5a47-cb3a-4794-bc1e-dcbb82e25352,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576d5a47-cb') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap576d5a47-cb, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: INFO os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=576d5a47-cb3a-4794-bc1e-dcbb82e25352,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap576d5a47-cb')
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a4:70,bridge_name='br-int',has_traffic_filtering=True,id=db299c0f-eae0-45ae-ba9c-037c50e06a3c,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb299c0f-ea') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a4:70,bridge_name='br-int',has_traffic_filtering=True,id=db299c0f-eae0-45ae-ba9c-037c50e06a3c,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb299c0f-ea') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb299c0f-ea, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: INFO os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a4:70,bridge_name='br-int',has_traffic_filtering=True,id=db299c0f-eae0-45ae-ba9c-037c50e06a3c,network=Network(6a9ec2be-6611-45ca-8b5d-d038014f5fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb299c0f-ea')
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:3b:f1,bridge_name='br-int',has_traffic_filtering=True,id=66cd1e83-c736-444c-84c7-ecfc2c2b3802,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd1e83-c7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:3b:f1,bridge_name='br-int',has_traffic_filtering=True,id=66cd1e83-c736-444c-84c7-ecfc2c2b3802,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd1e83-c7') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66cd1e83-c7, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: INFO os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:3b:f1,bridge_name='br-int',has_traffic_filtering=True,id=66cd1e83-c736-444c-84c7-ecfc2c2b3802,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd1e83-c7')
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2047298222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2047298222',id=9,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyckVm5q0K/VWofCbMcEV46KQZxBj3ALqxEq1WGPCmcfHfh7/cOxJHS+Hv+mvtlg5mQG1fMlQSB7wNEnw7JVo1xfMS0/PlorNNkjUUfy3JiEb0Ab+MsHcBaiy3VJowOJw==',key_name='tempest-keypair-791454951',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1afa97b49ae647c899a05d54b7f0f16b',ramdisk_id='',reservation_id='r-w5aico7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1381679461',owner_user_name='tempest-TaggedBootDevicesTest_v242-1381679461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f44f0d0807342ba9b851e7530a82294',uuid=dde6b4d2-9288-474c-b400-ce3b6f393b24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "address": "fa:16:3e:1a:59:78", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c8382-c8", "ovs_interfaceid": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converting VIF {"id": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "address": "fa:16:3e:1a:59:78", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c8382-c8", "ovs_interfaceid": "7e8c8382-c878-4ac7-b626-01cf2bc2f349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:78,bridge_name='br-int',has_traffic_filtering=True,id=7e8c8382-c878-4ac7-b626-01cf2bc2f349,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c8382-c8') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:78,bridge_name='br-int',has_traffic_filtering=True,id=7e8c8382-c878-4ac7-b626-01cf2bc2f349,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c8382-c8') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e8c8382-c8, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:14 user nova-compute[82196]: INFO os_vif [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:78,bridge_name='br-int',has_traffic_filtering=True,id=7e8c8382-c878-4ac7-b626-01cf2bc2f349,network=Network(cd5b7d14-5fc8-4029-82c0-4f44b7c7a975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c8382-c8')
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMjOdxbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:14 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.neutron [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Updating instance_info_cache with network_info: [{"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Releasing lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] Acquired lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.neutron [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Refreshing network info cache for port 8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed9c295-dbab-4c2d-921c-e7ca1f1f8853]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:14 user nova-compute[82196]: No targets found.
Apr 11 19:24:14 user nova-compute[82196]: iSNS:
Apr 11 19:24:14 user nova-compute[82196]: No targets found.
Apr 11 19:24:14 user nova-compute[82196]: STATIC:
Apr 11 19:24:14 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09
Apr 11 19:24:14 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:14 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:14 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef
Apr 11 19:24:14 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:14 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:14 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:14 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:14 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:14 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235
Apr 11 19:24:14 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:14 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:14 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101
Apr 11 19:24:14 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:14 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:14 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089
Apr 11 19:24:14 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:14 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:14 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013
Apr 11 19:24:14 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:14 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:14 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:14 user nova-compute[82196]: No targets found.
Apr 11 19:24:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:14 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:14 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1612946736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1612946736',id=8,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkMpWQuEm1Fv+W/mgY2OYSpggOfZUkoqqxBP4ppJK2h2yfEMM/I7umHLLvv+GHOLnvt+9wKNIfVoID5wNvYw3ZjffzrYq9zAWGLTOYlDtqreEy1EmtTM6C5cfTlcrcO1Q==',key_name='tempest-keypair-1575443570',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f39e7fdf571442b0a6f136020a99f7fb',ramdisk_id='',reservation_id='r-fla1mq5n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1678913086',owner_user_name='tempest-TaggedAttachmentsTest-1678913086-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f84e7cbdf6a4e588753fea907beba0c',uuid=b71d95ed-728d-4386-b7c6-50b252718ca9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converting VIF {"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7,network=Network(e6c6359b-b540-4414-b8d0-150634a2c699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3ff9dd-32') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_vif [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7,network=Network(e6c6359b-b540-4414-b8d0-150634a2c699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3ff9dd-32') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f3ff9dd-32, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f3ff9dd-32, col_values=(('external_ids', {'iface-id': '8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:9d:84', 'vm-uuid': 'b71d95ed-728d-4386-b7c6-50b252718ca9'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d21cc1-376d-4f0f-9376-a7dad980cd20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: INFO os_vif [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7,network=Network(e6c6359b-b540-4414-b8d0-150634a2c699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3ff9dd-32')
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1612946736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1612946736',id=8,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkMpWQuEm1Fv+W/mgY2OYSpggOfZUkoqqxBP4ppJK2h2yfEMM/I7umHLLvv+GHOLnvt+9wKNIfVoID5wNvYw3ZjffzrYq9zAWGLTOYlDtqreEy1EmtTM6C5cfTlcrcO1Q==',key_name='tempest-keypair-1575443570',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f39e7fdf571442b0a6f136020a99f7fb',ramdisk_id='',reservation_id='r-fla1mq5n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1678913086',owner_user_name='tempest-TaggedAttachmentsTest-1678913086-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f84e7cbdf6a4e588753fea907beba0c',uuid=b71d95ed-728d-4386-b7c6-50b252718ca9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converting VIF {"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7,network=Network(e6c6359b-b540-4414-b8d0-150634a2c699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3ff9dd-32') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] attach device xml: <interface type="ethernet">
Apr 11 19:24:14 user nova-compute[82196]:   <mac address="fa:16:3e:b5:9d:84"/>
Apr 11 19:24:14 user nova-compute[82196]:   <model type="virtio"/>
Apr 11 19:24:14 user nova-compute[82196]:   <mtu size="1442"/>
Apr 11 19:24:14 user nova-compute[82196]:   <target dev="tap8f3ff9dd-32"/>
Apr 11 19:24:14 user nova-compute[82196]: </interface>
Apr 11 19:24:14 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c39b329-00a1-42e8-8fb9-8dda5df293ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9281adaf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09'): ({'sdb'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Removing single pathed devices sdb {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[36983291-a920-4c7f-8466-c6b02fad2e9c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBvoZldI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:14 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[939f9660-e0a8-4da5-9082-b8b173efd5f3]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Flushing IO for device /dev/sdb {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd83520-2f4a-483f-8a37-ace55e20d39e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbbe9e1-4c0a-4b48-b690-9e44c98b8390]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0890169f-8e5b-4cc2-941a-be4572659685]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-4768cc5b-e792-4c52-805a-7f288ed9fbe5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-4768cc5b-e792-4c52-805a-7f288ed9fbe5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:14 user nova-compute[82196]: WARNING nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-4768cc5b-e792-4c52-805a-7f288ed9fbe5 for instance with vm_state active and task_state deleting.
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-unplugged-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:14 user nova-compute[82196]: WARNING nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-1d14016e-af6d-4ce8-bd51-8a9dba7c4261 for instance with vm_state active and task_state deleting.
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-unplugged-576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-576d5a47-cb3a-4794-bc1e-dcbb82e25352 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:14 user nova-compute[82196]: WARNING nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-576d5a47-cb3a-4794-bc1e-dcbb82e25352 for instance with vm_state active and task_state deleting.
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-unplugged-db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-db299c0f-eae0-45ae-ba9c-037c50e06a3c for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:14 user nova-compute[82196]: WARNING nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-db299c0f-eae0-45ae-ba9c-037c50e06a3c for instance with vm_state active and task_state deleting.
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-unplugged-7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-unplugged-7e8c8382-c878-4ac7-b626-01cf2bc2f349 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:14 user nova-compute[82196]: WARNING nova.compute.manager [req-74d2f6b7-ba26-4622-b7fb-5cbe2790bf1d req-ea50688c-c529-484a-a5bb-c2f768da6d3f service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-7e8c8382-c878-4ac7-b626-01cf2bc2f349 for instance with vm_state active and task_state deleting.
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c64122-c266-454c-9759-9dbe5c83e0eb]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09, portal: 172.16.0.220,3260]
Apr 11 19:24:14 user nova-compute[82196]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a38d7c75-168f-480e-8f42-0c2606086f09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0626076a-763d-4c83-af0d-3f9bb69a0772]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] <== disconnect_volume: return (430ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.263s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:14 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:14 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnKdoRUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:14 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5c5600-35be-4b02-9fd1-ae0e72ed019c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:24:14 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ea33b9-1cae-4046-b548-e0b7aaea5865]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe] added
Apr 11 19:24:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fe85b3-7f78-4bdf-8503-5f1fe6be2836]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdf4b84-a583-4510-9abf-ac4e291ddfd3]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bBvoZldI {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] No BDM found with device name hda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] No VIF found with MAC fa:16:3e:85:20:b8, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bBvoZldI" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea633f1-a108-4755-8abd-ab5572060624]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bBvoZldI'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[13976ad7-cbb6-41c0-8d3f-c96733195910]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:24:14 user nova-compute[82196]:   <nova:package version="0.0.0"/>
Apr 11 19:24:14 user nova-compute[82196]:   <nova:name>tempest-device-tagging-server-1612946736</nova:name>
Apr 11 19:24:14 user nova-compute[82196]:   <nova:creationTime>2023-04-11 19:24:14</nova:creationTime>
Apr 11 19:24:14 user nova-compute[82196]:   <nova:flavor name="m1.nano">
Apr 11 19:24:14 user nova-compute[82196]:     <nova:memory>128</nova:memory>
Apr 11 19:24:14 user nova-compute[82196]:     <nova:disk>1</nova:disk>
Apr 11 19:24:14 user nova-compute[82196]:     <nova:swap>0</nova:swap>
Apr 11 19:24:14 user nova-compute[82196]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:24:14 user nova-compute[82196]:     <nova:vcpus>1</nova:vcpus>
Apr 11 19:24:14 user nova-compute[82196]:   </nova:flavor>
Apr 11 19:24:14 user nova-compute[82196]:   <nova:owner>
Apr 11 19:24:14 user nova-compute[82196]:     <nova:user uuid="2f84e7cbdf6a4e588753fea907beba0c">tempest-TaggedAttachmentsTest-1678913086-project-member</nova:user>
Apr 11 19:24:14 user nova-compute[82196]:     <nova:project uuid="f39e7fdf571442b0a6f136020a99f7fb">tempest-TaggedAttachmentsTest-1678913086</nova:project>
Apr 11 19:24:14 user nova-compute[82196]:   </nova:owner>
Apr 11 19:24:14 user nova-compute[82196]:   <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:24:14 user nova-compute[82196]:   <nova:ports>
Apr 11 19:24:14 user nova-compute[82196]:     <nova:port uuid="64bd141d-04e6-46e6-bb46-e997d3234fa1">
Apr 11 19:24:14 user nova-compute[82196]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:24:14 user nova-compute[82196]:     </nova:port>
Apr 11 19:24:14 user nova-compute[82196]:     <nova:port uuid="8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7">
Apr 11 19:24:14 user nova-compute[82196]:       <nova:ip type="fixed" address="10.10.10.237" ipVersion="4"/>
Apr 11 19:24:14 user nova-compute[82196]:     </nova:port>
Apr 11 19:24:14 user nova-compute[82196]:   </nova:ports>
Apr 11 19:24:14 user nova-compute[82196]: </nova:instance>
Apr 11 19:24:14 user nova-compute[82196]:  {{(pid=82196) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4667b8f8-1f5d-41db-9eb8-fd8e120ca336]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c220a37e-8657-4d8e-aa7a-7968b0f0623c tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "interface-b71d95ed-728d-4386-b7c6-50b252718ca9-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.393s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4bf134-1a43-4f55-873d-cb7ae11edc30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe, portal: 172.16.0.220,3260]
Apr 11 19:24:14 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ef3311-1376-4d30-8691-eb7a647f8e05]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d37c7c-9cfc-4a52-889a-25a635893aa5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:24:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.network.neutron [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Updated VIF entry in instance network info cache for port 8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.network.neutron [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Updating instance_info_cache with network_info: [{"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.035s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ea739b-554b-4c1c-aa2a-243be6d33e4a]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-da2764f8-1c42-41de-b0be-2481bf890d89 req-263761f8-da83-47a9-a87a-0e86bd0ec36b service nova] Releasing lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBvoZldI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "b71d95ed-728d-4386-b7c6-50b252718ca9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.objects.instance [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lazy-loading 'flavor' on Instance uuid b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "8e449d09-f632-4f57-b304-430734096596" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "8e449d09-f632-4f57-b304-430734096596" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "8e449d09-f632-4f57-b304-430734096596-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "8e449d09-f632-4f57-b304-430734096596-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "8e449d09-f632-4f57-b304-430734096596-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:15 user nova-compute[82196]: INFO nova.compute.manager [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Terminating instance
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-01625bab-061b-4f3d-8c32-e6d2a70147f5 req-343c61f6-972a-4c2f-8f2e-7b6b93033fd8 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-plugged-66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-01625bab-061b-4f3d-8c32-e6d2a70147f5 req-343c61f6-972a-4c2f-8f2e-7b6b93033fd8 service nova] Acquiring lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-01625bab-061b-4f3d-8c32-e6d2a70147f5 req-343c61f6-972a-4c2f-8f2e-7b6b93033fd8 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-01625bab-061b-4f3d-8c32-e6d2a70147f5 req-343c61f6-972a-4c2f-8f2e-7b6b93033fd8 service nova] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-01625bab-061b-4f3d-8c32-e6d2a70147f5 req-343c61f6-972a-4c2f-8f2e-7b6b93033fd8 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] No waiting events found dispatching network-vif-plugged-66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:15 user nova-compute[82196]: WARNING nova.compute.manager [req-01625bab-061b-4f3d-8c32-e6d2a70147f5 req-343c61f6-972a-4c2f-8f2e-7b6b93033fd8 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received unexpected event network-vif-plugged-66cd1e83-c736-444c-84c7-ecfc2c2b3802 for instance with vm_state active and task_state deleting.
Apr 11 19:24:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "b71d95ed-728d-4386-b7c6-50b252718ca9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:15 user nova-compute[82196]: INFO nova.compute.manager [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Attaching volume 65685406-4266-4909-9989-927850da7d53 to /dev/vdb
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received event network-vif-plugged-8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] Acquiring lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] No waiting events found dispatching network-vif-plugged-8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:15 user nova-compute[82196]: WARNING nova.compute.manager [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received unexpected event network-vif-plugged-8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 for instance with vm_state active and task_state None.
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received event network-vif-plugged-8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] Acquiring lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] No waiting events found dispatching network-vif-plugged-8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:15 user nova-compute[82196]: WARNING nova.compute.manager [req-29cea411-e79e-47a3-8197-30745c6b548a req-6bee10ae-1fd9-4f1e-ac7f-ede5a28a71ac service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received unexpected event network-vif-plugged-8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 for instance with vm_state active and task_state None.
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHpNUuhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:15 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG os_brick.utils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[44566656-1324-4774-9449-de4fbee9e13c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4124db-aefb-4e5d-bdd6-83bee51354c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd45bad4-4a18-48a5-a3c1-4406d28cf6d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5c04a1-ce9b-4dab-99b2-179148b1059b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmxvSPRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:15 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:15 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:24:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4477be-7901-49c1-a5d5-2482050789e5]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG os_brick.utils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:15 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Updating existing volume attachment record: a019ac42-bfda-460a-a8e2-fe66c3e9ff89 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:24:16 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 8e449d09-f632-4f57-b304-430734096596] Instance destroyed successfully.
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.objects.instance [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lazy-loading 'resources' on Instance uuid 8e449d09-f632-4f57-b304-430734096596 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1077608511',display_name='tempest-VolumesActionsTest-instance-1077608511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1077608511',id=10,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7543456a70d04d7f8c50f37e64b7ee9c',ramdisk_id='',reservation_id='r-xt2ua9hy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2124197416',owner_user_name='tempest-VolumesActionsTest-2124197416-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:39Z,user_data=None,user_id='7c9641ceb17e4914b1cdf061c5bdc79f',uuid=8e449d09-f632-4f57-b304-430734096596,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "address": "fa:16:3e:ca:c6:e4", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dea909b-ea", "ovs_interfaceid": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Converting VIF {"id": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "address": "fa:16:3e:ca:c6:e4", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dea909b-ea", "ovs_interfaceid": "5dea909b-eaed-4978-b239-4177f6cbdfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=5dea909b-eaed-4978-b239-4177f6cbdfdc,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dea909b-ea') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_vif [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=5dea909b-eaed-4978-b239-4177f6cbdfdc,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dea909b-ea') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] <== connect_volume: return (1711ms) {'type': 'block', 'scsi_wwn': '23538613030643163', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538613030643163', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dea909b-ea, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.449s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:16 user nova-compute[82196]: INFO os_vif [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=5dea909b-eaed-4978-b239-4177f6cbdfdc,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dea909b-ea')
Apr 11 19:24:16 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Deleting instance files /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596_del
Apr 11 19:24:16 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Deletion of /opt/stack/data/nova/instances/8e449d09-f632-4f57-b304-430734096596_del complete
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.objects.instance [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lazy-loading 'flavor' on Instance uuid 9941d033-15c2-4069-b9a6-f80840e95a38 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf17ae3-8069-4804-a1fa-fc787f457608]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:16 user nova-compute[82196]: No targets found.
Apr 11 19:24:16 user nova-compute[82196]: iSNS:
Apr 11 19:24:16 user nova-compute[82196]: No targets found.
Apr 11 19:24:16 user nova-compute[82196]: STATIC:
Apr 11 19:24:16 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef
Apr 11 19:24:16 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:16 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:16 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:16 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:16 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:16 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe
Apr 11 19:24:16 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:16 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:16 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235
Apr 11 19:24:16 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:16 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:16 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101
Apr 11 19:24:16 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:16 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:16 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089
Apr 11 19:24:16 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:16 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:16 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013
Apr 11 19:24:16 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:16 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:16 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:16 user nova-compute[82196]: No targets found.
Apr 11 19:24:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:16 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:16 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b6c38f-b403-4ffc-a578-763293315ee5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:24:16 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:16 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:24:16 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:24:16 user nova-compute[82196]:   <serial>447d1208-42c3-46ec-b882-104ae99ab8fe</serial>
Apr 11 19:24:16 user nova-compute[82196]: </disk>
Apr 11 19:24:16 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c373eb36-6a5d-4ee3-acd4-88aa90068fbd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9281a57910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235'): ({'sdc'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Removing single pathed devices sdc {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d2e2d4-00cc-4514-9de3-b96bedd6e372]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: INFO nova.compute.manager [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: 8e449d09-f632-4f57-b304-430734096596] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 8e449d09-f632-4f57-b304-430734096596] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 8e449d09-f632-4f57-b304-430734096596] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d64d301-c830-4dfd-b9a9-6a7cb7c7019c]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Flushing IO for device /dev/sdc {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4341e1-3905-4153-bf65-2563ed0235f4]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d78ebe6-020f-4f4d-965c-7245b3497067]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cbb0fc-5ac3-4193-bc0b-018ef598ad62]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dede10-1ea1-4328-9fad-1a9f3965c95f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235, portal: 172.16.0.220,3260]
Apr 11 19:24:16 user nova-compute[82196]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:125a0bcb-5bbf-4fa8-81f5-f9054a4a2235 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cefda4a-412c-4b2a-82b8-607fd28a4a35]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] <== disconnect_volume: return (1804ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.927s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:16 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:16 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjxznITU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:16 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[830d6291-211e-4621-88b2-312528139b91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:24:16 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[343b7a27-8018-46b4-95fb-be9653995115]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694] added
Apr 11 19:24:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[497641b1-13cc-4b2f-aa67-938f3aa6e202]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b67b6d-7da7-4e39-837c-a441a1dc8c5b]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OHpNUuhQ {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OHpNUuhQ" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1330ed-f334-4f8a-a8eb-aaa596a7c149]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OHpNUuhQ'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7460a5e2-0e3b-4cd9-9a18-78d870f80d8f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] No VIF found with MAC fa:16:3e:b6:4d:98, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7d5bb1-bdbd-4f48-ac74-b1b882596ee2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 8e449d09-f632-4f57-b304-430734096596] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f041df1-466a-4a5b-a164-2698e9829d26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260]
Apr 11 19:24:16 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:16 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 8e449d09-f632-4f57-b304-430734096596] Took 0.54 seconds to deallocate network for instance.
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5270067-6a8a-4416-8323-83a8cd30c1d7]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[706e9903-8574-4325-a40d-fb611683e3bd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d7ee8c8-1fd2-4400-81c3-89a221679f69 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "9941d033-15c2-4069-b9a6-f80840e95a38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.588s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc48ac1-13b8-4794-a845-9923521a40b9]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:24:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHpNUuhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:17 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Deleted allocations for instance 8e449d09-f632-4f57-b304-430734096596
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-025ccd39-853e-4e56-94e4-623042df7f0c tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "8e449d09-f632-4f57-b304-430734096596" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.066s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Received event network-vif-unplugged-5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] Acquiring lock "8e449d09-f632-4f57-b304-430734096596-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] Lock "8e449d09-f632-4f57-b304-430734096596-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] Lock "8e449d09-f632-4f57-b304-430734096596-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] No waiting events found dispatching network-vif-unplugged-5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:17 user nova-compute[82196]: WARNING nova.compute.manager [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Received unexpected event network-vif-unplugged-5dea909b-eaed-4978-b239-4177f6cbdfdc for instance with vm_state deleted and task_state None.
Apr 11 19:24:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Received event network-vif-plugged-5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] Acquiring lock "8e449d09-f632-4f57-b304-430734096596-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] Lock "8e449d09-f632-4f57-b304-430734096596-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] Lock "8e449d09-f632-4f57-b304-430734096596-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] No waiting events found dispatching network-vif-plugged-5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:17 user nova-compute[82196]: WARNING nova.compute.manager [req-4918d90a-24b7-43c3-8811-3e1ebe4d5e5f req-a1413f02-94e1-497e-8538-efb8276aff08 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Received unexpected event network-vif-plugged-5dea909b-eaed-4978-b239-4177f6cbdfdc for instance with vm_state deleted and task_state None.
Apr 11 19:24:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-ab3ed9db-acb8-4f21-9455-a90b74d19102 req-52dfd333-9147-4dcd-aa33-24ce280f2529 service nova] [instance: 8e449d09-f632-4f57-b304-430734096596] Received event network-vif-deleted-5dea909b-eaed-4978-b239-4177f6cbdfdc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] <== connect_volume: return (2316ms) {'type': 'block', 'scsi_wwn': '23335356432643137', 'path': '/dev/sdc'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335356432643137', 'path': '/dev/sdc'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.127s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:17 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:17 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lazy-loading 'flavor' on Instance uuid a49d379e-3976-4d68-b6df-f572a922107c {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d792db4-36f8-43f1-9ebf-c9d93b379a24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:24:17 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:24:17 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:17 user nova-compute[82196]:   <source dev="/dev/sdc"/>
Apr 11 19:24:17 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:24:17 user nova-compute[82196]:   <serial>51e97579-56cc-414f-9a25-3a7c7d045694</serial>
Apr 11 19:24:17 user nova-compute[82196]: </disk>
Apr 11 19:24:17 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b6305c-9075-40e7-8e1f-2a0f416ecd14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79] added
Apr 11 19:24:17 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6867fa-3b9c-4f32-9eba-baf7a4c0a3a5]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ff1b4-ec5e-4a52-96e0-15fb5d974ed7]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmxvSPRH {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmxvSPRH" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebababf-c905-42bb-a7cb-28fe551687d1]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jmxvSPRH'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c6a6f-84c9-452c-86c3-1893af814a00]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[519bc0e0-394b-443a-ba80-6cb6653e2d68]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab50dd8-7cef-46ef-9870-fd9450d81153]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79, portal: 172.16.0.220,3260]
Apr 11 19:24:18 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae135e13-fff4-4c21-93ec-3f16410852c3]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f8fd32-6f2a-4e09-90bd-7443d4e66723]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b24f995-92aa-4670-b184-28745856a81d]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmxvSPRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] No VIF found with MAC fa:16:3e:bf:52:8c, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8a02dffa-2c07-4db4-9bbb-fd93a368dede tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a49d379e-3976-4d68-b6df-f572a922107c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.712s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "9941d033-15c2-4069-b9a6-f80840e95a38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "9941d033-15c2-4069-b9a6-f80840e95a38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:18 user nova-compute[82196]: INFO nova.compute.manager [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Detaching volume 447d1208-42c3-46ec-b882-104ae99ab8fe
Apr 11 19:24:18 user nova-compute[82196]: INFO nova.virt.block_device [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Attempting to driver detach volume 447d1208-42c3-46ec-b882-104ae99ab8fe from mountpoint /dev/vdb
Apr 11 19:24:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Attempting to detach device vdb from instance 9941d033-15c2-4069-b9a6-f80840e95a38 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:24:18 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:18 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:24:18 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:24:18 user nova-compute[82196]:   <serial>447d1208-42c3-46ec-b882-104ae99ab8fe</serial>
Apr 11 19:24:18 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:24:18 user nova-compute[82196]: </disk>
Apr 11 19:24:18 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:24:18 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Successfully detached device vdb from instance 9941d033-15c2-4069-b9a6-f80840e95a38 from the persistent domain config.
Apr 11 19:24:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9941d033-15c2-4069-b9a6-f80840e95a38 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:24:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:24:18 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:18 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:24:18 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:24:18 user nova-compute[82196]:   <serial>447d1208-42c3-46ec-b882-104ae99ab8fe</serial>
Apr 11 19:24:18 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:24:18 user nova-compute[82196]: </disk>
Apr 11 19:24:18 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241059.0143068, 9941d033-15c2-4069-b9a6-f80840e95a38 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9941d033-15c2-4069-b9a6-f80840e95a38 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:24:19 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Successfully detached device vdb from instance 9941d033-15c2-4069-b9a6-f80840e95a38 from the live domain config.
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBvoZldI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:19 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] <== connect_volume: return (3492ms) {'type': 'block', 'scsi_wwn': '26438393735633261', 'path': '/dev/sdi'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438393735633261', 'path': '/dev/sdi'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.753s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.objects.instance [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lazy-loading 'flavor' on Instance uuid 1ded3918-3bae-465c-a53c-e88011914c50 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Acquiring lock "a49d379e-3976-4d68-b6df-f572a922107c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "a49d379e-3976-4d68-b6df-f572a922107c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2fb80e-65bb-492d-8606-31427772406d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:19 user nova-compute[82196]: No targets found.
Apr 11 19:24:19 user nova-compute[82196]: iSNS:
Apr 11 19:24:19 user nova-compute[82196]: No targets found.
Apr 11 19:24:19 user nova-compute[82196]: STATIC:
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:19 user nova-compute[82196]: No targets found.
Apr 11 19:24:19 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:19 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:19 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:24:19 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:19 user nova-compute[82196]:   <source dev="/dev/sdi"/>
Apr 11 19:24:19 user nova-compute[82196]:   <target dev="sdc" bus="scsi"/>
Apr 11 19:24:19 user nova-compute[82196]:   <serial>d7bac8da-a912-4a54-b7d8-a012f3ff9c79</serial>
Apr 11 19:24:19 user nova-compute[82196]:   <address type="drive" controller="0" unit="2"/>
Apr 11 19:24:19 user nova-compute[82196]: </disk>
Apr 11 19:24:19 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.utils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a831f7-fdfd-4920-a447-404be865133d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1beb30-9a4c-4d25-9795-fab7ca89f356]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae1216b-dcb5-4c38-a54d-398260d128db]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9281a55ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef'): ({'sdd'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Removing single pathed devices sdd {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dd911c-71cd-49e8-aed4-59d12293c724]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e1c176-b15c-43ea-ab57-0a321d3f1dff]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d018ebf6-68c8-4f24-8185-a6b8681cc846]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[19245db2-0be1-492b-a9c3-70ff4854ddc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aa87fc-7fe0-4067-a0b2-b824a9c3b274]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Flushing IO for device /dev/sdd {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:19 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[772d6172-6ffc-4011-bcb2-6707499bbc4b]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bcc379-b089-4e00-bca5-06a02b9e450b]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.utils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e74582-ecad-474a-b484-1924d70278e7]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[23793efc-eb3f-4b7e-b7b6-5fb9910e36f8]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbd05ae-f7d6-46f5-95ff-5cee1bfe882e]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef, portal: 172.16.0.220,3260]
Apr 11 19:24:19 user nova-compute[82196]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:19 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: INFO nova.compute.manager [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Swapping volume 51e97579-56cc-414f-9a25-3a7c7d045694 for 666f5f51-f96b-47f7-9acf-7d0b1c27ecd0
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6fb879-bd91-4f68-a952-095dadc5eaef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca3c7e9-e819-4201-9d86-4e68ab045dce]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] <== disconnect_volume: return (3122ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:19 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Deleting instance files /opt/stack/data/nova/instances/dde6b4d2-9288-474c-b400-ce3b6f393b24_del
Apr 11 19:24:19 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Deletion of /opt/stack/data/nova/instances/dde6b4d2-9288-474c-b400-ce3b6f393b24_del complete
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.562s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f67d10-33f4-4216-b346-912cc9063339]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:19 user nova-compute[82196]: No targets found.
Apr 11 19:24:19 user nova-compute[82196]: iSNS:
Apr 11 19:24:19 user nova-compute[82196]: No targets found.
Apr 11 19:24:19 user nova-compute[82196]: STATIC:
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013
Apr 11 19:24:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:19 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:19 user nova-compute[82196]: No targets found.
Apr 11 19:24:19 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:19 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:19 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fcbf05-60c9-4fed-b321-7fc2cea3964c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: INFO nova.compute.manager [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Took 7.71 seconds to destroy the instance on the hypervisor.
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9ba0b3-ad2f-4874-a427-cd18b9e1b5b1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:19 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927c01aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe'): ({'sdb'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Removing single pathed devices sdb {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[346028ea-05fb-4bb9-9d0b-4ab4b327253c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a5f8de-fed0-40c3-9c34-2a97c64cbee4]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Flushing IO for device /dev/sdb {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] No BDM found with device name sda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] No BDM found with device name sdc, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] No VIF found with MAC fa:16:3e:67:5d:8a, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8984722-2582-4240-aab5-30fbc6ea1568]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[31acc057-a453-4ea4-ac34-e164106af5a3]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[882003b9-f4f7-4e0f-86c1-01741df5a8da]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-aeebc2db-b9e9-439e-8c9f-5ce86e0b933c tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "1ded3918-3bae-465c-a53c-e88011914c50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.139s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eb1dca-566c-4826-bfca-38ae6d1f0242]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe, portal: 172.16.0.220,3260]
Apr 11 19:24:19 user nova-compute[82196]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:19 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447d1208-42c3-46ec-b882-104ae99ab8fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e957f7-f018-4b94-8c67-b398eaf32a04]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] <== disconnect_volume: return (920ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cejJuLmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:20 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:20 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:20 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8fc397-c299-4baa-855f-4441deabdf53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:24:20 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0dbdfb-2604-4ecd-9f2e-dcd5eadfc5b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53] added
Apr 11 19:24:20 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a555caec-afd5-45df-868f-16789b813e5a]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dcfb56-f10a-42bd-91d1-fd268fab8d44]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cejJuLmw {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cejJuLmw" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[111bbd76-7e9f-461f-bd1b-faadbc1b4f5d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cejJuLmw'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8a5228-0ea5-48b5-9f91-a9538d691fcd]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4596e88a-ed3b-4f87-a324-bf04b1fe3b0f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41d95c3-8036-4ac8-9d50-a8004b013d88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53, portal: 172.16.0.220,3260]
Apr 11 19:24:20 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:20 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bead0a00-7b87-4406-a306-a778919c3fcd]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf8fc8-157b-41a7-9bc9-bb1e981df08d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:20 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50f4b0e-3a83-46c5-8e84-9c069c9aa9ae]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:24:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cejJuLmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-50ab0b1d-8ad5-4f1f-9e26-edcc338d4076 req-45646116-abeb-4c11-af76-543c17ff0b09 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-deleted-7e8c8382-c878-4ac7-b626-01cf2bc2f349 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:21 user nova-compute[82196]: INFO nova.compute.manager [req-50ab0b1d-8ad5-4f1f-9e26-edcc338d4076 req-45646116-abeb-4c11-af76-543c17ff0b09 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Neutron deleted interface 7e8c8382-c878-4ac7-b626-01cf2bc2f349; detaching it from the instance and deleting it from the info cache
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.network.neutron [req-50ab0b1d-8ad5-4f1f-9e26-edcc338d4076 req-45646116-abeb-4c11-af76-543c17ff0b09 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [{"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "address": "fa:16:3e:56:3b:f1", "network": {"id": "cd5b7d14-5fc8-4029-82c0-4f44b7c7a975", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256580935", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd1e83-c7", "ovs_interfaceid": "66cd1e83-c736-444c-84c7-ecfc2c2b3802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-50ab0b1d-8ad5-4f1f-9e26-edcc338d4076 req-45646116-abeb-4c11-af76-543c17ff0b09 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Detach interface failed, port_id=7e8c8382-c878-4ac7-b626-01cf2bc2f349, reason: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "1ded3918-3bae-465c-a53c-e88011914c50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "1ded3918-3bae-465c-a53c-e88011914c50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:21 user nova-compute[82196]: INFO nova.compute.manager [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Detaching volume d7bac8da-a912-4a54-b7d8-a012f3ff9c79
Apr 11 19:24:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23539613837306134', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539613837306134', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.objects.instance [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lazy-loading 'flavor' on Instance uuid b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:24:21 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:21 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:24:21 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:24:21 user nova-compute[82196]:   <serial>65685406-4266-4909-9989-927850da7d53</serial>
Apr 11 19:24:21 user nova-compute[82196]: </disk>
Apr 11 19:24:21 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:24:21 user nova-compute[82196]: INFO nova.virt.block_device [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Attempting to driver detach volume d7bac8da-a912-4a54-b7d8-a012f3ff9c79 from mountpoint /dev/sdc
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Attempting to detach device sdc from instance 1ded3918-3bae-465c-a53c-e88011914c50 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:24:21 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:21 user nova-compute[82196]:   <source dev="/dev/sdi"/>
Apr 11 19:24:21 user nova-compute[82196]:   <target dev="sdc" bus="scsi"/>
Apr 11 19:24:21 user nova-compute[82196]:   <serial>d7bac8da-a912-4a54-b7d8-a012f3ff9c79</serial>
Apr 11 19:24:21 user nova-compute[82196]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 19:24:21 user nova-compute[82196]: </disk>
Apr 11 19:24:21 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:24:21 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Successfully detached device sdc from instance 1ded3918-3bae-465c-a53c-e88011914c50 from the persistent domain config.
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 1ded3918-3bae-465c-a53c-e88011914c50 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:24:21 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:21 user nova-compute[82196]:   <source dev="/dev/sdi"/>
Apr 11 19:24:21 user nova-compute[82196]:   <target dev="sdc" bus="scsi"/>
Apr 11 19:24:21 user nova-compute[82196]:   <serial>d7bac8da-a912-4a54-b7d8-a012f3ff9c79</serial>
Apr 11 19:24:21 user nova-compute[82196]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 19:24:21 user nova-compute[82196]: </disk>
Apr 11 19:24:21 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] No BDM found with device name hda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] No VIF found with MAC fa:16:3e:85:20:b8, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59deae07-0a4b-407f-be6c-1170fa12c310 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.649s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241062.0828145, 1ded3918-3bae-465c-a53c-e88011914c50 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 1ded3918-3bae-465c-a53c-e88011914c50 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:24:22 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Successfully detached device sdc from instance 1ded3918-3bae-465c-a53c-e88011914c50 from the live domain config.
Apr 11 19:24:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmxvSPRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:22 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15c6454-04f6-4435-86ff-7f977466e0f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:22 user nova-compute[82196]: No targets found.
Apr 11 19:24:22 user nova-compute[82196]: iSNS:
Apr 11 19:24:22 user nova-compute[82196]: No targets found.
Apr 11 19:24:22 user nova-compute[82196]: STATIC:
Apr 11 19:24:22 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694
Apr 11 19:24:22 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:22 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:22 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:22 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:22 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:22 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53
Apr 11 19:24:22 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:22 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:22 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79
Apr 11 19:24:22 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:22 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:22 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101
Apr 11 19:24:22 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:22 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:22 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089
Apr 11 19:24:22 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:22 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:22 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013
Apr 11 19:24:22 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:22 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:22 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:22 user nova-compute[82196]: No targets found.
Apr 11 19:24:22 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:22 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:22 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8783e9f-5b3e-48fe-ae45-9e3995546955]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c54642b-ec8b-45cb-8130-7e006d3e7900]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:22 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92641181f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79'): ({'sdi'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Removing single pathed devices sdi {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[18716499-1067-4896-a703-76356ebeaad2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db946e-26f4-484a-bf59-23d465c417a2]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Flushing IO for device /dev/sdi {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b459f0e2-9be2-456f-9fbb-88c801b598fa]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a3ceba-c026-44d2-a696-66a6598853b2]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] SCSI volumes sdi have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d699678-8eee-47cd-8f1e-03ba0ca6e36c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c63172f-3ee2-4064-8752-0b8736c3fb24]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79, portal: 172.16.0.220,3260]
Apr 11 19:24:22 user nova-compute[82196]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:22 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7bac8da-a912-4a54-b7d8-a012f3ff9c79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[71554c8f-7023-44dc-bd42-16294eec0fa3]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] <== disconnect_volume: return (358ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-deleted-66cd1e83-c736-444c-84c7-ecfc2c2b3802 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:23 user nova-compute[82196]: INFO nova.compute.manager [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Neutron deleted interface 66cd1e83-c736-444c-84c7-ecfc2c2b3802; detaching it from the instance and deleting it from the info cache
Apr 11 19:24:23 user nova-compute[82196]: DEBUG nova.network.neutron [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [{"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "address": "fa:16:3e:cf:18:6e", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap576d5a47-cb", "ovs_interfaceid": "576d5a47-cb3a-4794-bc1e-dcbb82e25352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Detach interface failed, port_id=66cd1e83-c736-444c-84c7-ecfc2c2b3802, reason: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:24:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-deleted-576d5a47-cb3a-4794-bc1e-dcbb82e25352 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:23 user nova-compute[82196]: INFO nova.compute.manager [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Neutron deleted interface 576d5a47-cb3a-4794-bc1e-dcbb82e25352; detaching it from the instance and deleting it from the info cache
Apr 11 19:24:23 user nova-compute[82196]: DEBUG nova.network.neutron [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [{"id": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "address": "fa:16:3e:df:00:78", "network": {"id": "17e7d3c3-aefe-4aac-82cb-be854d82b261", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-117624367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb74c01-d9", "ovs_interfaceid": "aeb74c01-d96e-4838-8d2c-c2499e3f8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "address": "fa:16:3e:23:4b:bd", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4768cc5b-e7", "ovs_interfaceid": "4768cc5b-e792-4c52-805a-7f288ed9fbe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "address": "fa:16:3e:23:66:df", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14016e-af", "ovs_interfaceid": "1d14016e-af6d-4ce8-bd51-8a9dba7c4261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "address": "fa:16:3e:c5:a4:70", "network": {"id": "6a9ec2be-6611-45ca-8b5d-d038014f5fd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-2009567320", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1afa97b49ae647c899a05d54b7f0f16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb299c0f-ea", "ovs_interfaceid": "db299c0f-eae0-45ae-ba9c-037c50e06a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:23 user nova-compute[82196]: DEBUG nova.objects.instance [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lazy-loading 'flavor' on Instance uuid 1ded3918-3bae-465c-a53c-e88011914c50 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-bb7ef298-02c3-44a2-9607-c7314c35b650 req-26f6b36f-94ef-41fc-ad46-ab5018501a7c service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Detach interface failed, port_id=576d5a47-cb3a-4794-bc1e-dcbb82e25352, reason: Instance dde6b4d2-9288-474c-b400-ce3b6f393b24 could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:24:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-53f529bd-1760-49fe-8339-7859e72b5a31 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "1ded3918-3bae-465c-a53c-e88011914c50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.092s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "1ded3918-3bae-465c-a53c-e88011914c50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "1ded3918-3bae-465c-a53c-e88011914c50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "1ded3918-3bae-465c-a53c-e88011914c50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "1ded3918-3bae-465c-a53c-e88011914c50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "1ded3918-3bae-465c-a53c-e88011914c50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:24 user nova-compute[82196]: INFO nova.compute.manager [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Terminating instance
Apr 11 19:24:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:24 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Took 4.44 seconds to deallocate network for instance.
Apr 11 19:24:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:24 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Instance destroyed successfully.
Apr 11 19:24:24 user nova-compute[82196]: DEBUG nova.objects.instance [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lazy-loading 'resources' on Instance uuid 1ded3918-3bae-465c-a53c-e88011914c50 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1588512874',display_name='tempest-AttachSCSIVolumeTestJSON-server-1588512874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1588512874',id=5,image_ref='8ddd1597-acbd-47c5-9492-af80f88fdca1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENNIAFAXgldDZ23gkfsz1j1aOWnEH0MZh4aSHSnn1OZB1BmGyYdsPQXM8u6LOOszDd5job+4SPRJzI9j1CzY2ryRwaV1faRl+V6jcoViXB4uLPiI16HL/Vfx/IZpK+Nsg==',key_name='tempest-keypair-1434827992',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4c6f64ecc104480a149bcfd0610dfef',ramdisk_id='',reservation_id='r-ipzh94nm',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8ddd1597-acbd-47c5-9492-af80f88fdca1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1532830376',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1532830376-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26555f273c374f9ba0ed151d2f1cbaef',uuid=1ded3918-3bae-465c-a53c-e88011914c50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "address": "fa:16:3e:67:5d:8a", "network": {"id": "a4f38bbd-d96e-48df-855f-7eff4d122089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1765637160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c6f64ecc104480a149bcfd0610dfef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f590426-37", "ovs_interfaceid": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Converting VIF {"id": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "address": "fa:16:3e:67:5d:8a", "network": {"id": "a4f38bbd-d96e-48df-855f-7eff4d122089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1765637160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c6f64ecc104480a149bcfd0610dfef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f590426-37", "ovs_interfaceid": "8f590426-373c-4a90-8829-a2ad1a61fcd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:5d:8a,bridge_name='br-int',has_traffic_filtering=True,id=8f590426-373c-4a90-8829-a2ad1a61fcd7,network=Network(a4f38bbd-d96e-48df-855f-7eff4d122089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f590426-37') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG os_vif [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:5d:8a,bridge_name='br-int',has_traffic_filtering=True,id=8f590426-373c-4a90-8829-a2ad1a61fcd7,network=Network(a4f38bbd-d96e-48df-855f-7eff4d122089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f590426-37') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f590426-37, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG nova.objects.instance [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lazy-loading 'flavor' on Instance uuid 9941d033-15c2-4069-b9a6-f80840e95a38 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:24 user nova-compute[82196]: INFO os_vif [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:5d:8a,bridge_name='br-int',has_traffic_filtering=True,id=8f590426-373c-4a90-8829-a2ad1a61fcd7,network=Network(a4f38bbd-d96e-48df-855f-7eff4d122089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f590426-37')
Apr 11 19:24:24 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Deleting instance files /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50_del
Apr 11 19:24:24 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Deletion of /opt/stack/data/nova/instances/1ded3918-3bae-465c-a53c-e88011914c50_del complete
Apr 11 19:24:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2af3465b-26cc-42a9-809e-f9861de007c0 tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "9941d033-15c2-4069-b9a6-f80840e95a38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.468s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "b71d95ed-728d-4386-b7c6-50b252718ca9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:25 user nova-compute[82196]: INFO nova.compute.manager [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:24:25 user nova-compute[82196]: INFO nova.compute.manager [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Detaching volume 65685406-4266-4909-9989-927850da7d53
Apr 11 19:24:25 user nova-compute[82196]: INFO nova.virt.block_device [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Attempting to driver detach volume 65685406-4266-4909-9989-927850da7d53 from mountpoint /dev/vdb
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Attempting to detach device vdb from instance b71d95ed-728d-4386-b7c6-50b252718ca9 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:24:25 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:25 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:24:25 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:24:25 user nova-compute[82196]:   <serial>65685406-4266-4909-9989-927850da7d53</serial>
Apr 11 19:24:25 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 19:24:25 user nova-compute[82196]: </disk>
Apr 11 19:24:25 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:24:25 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Successfully detached device vdb from instance b71d95ed-728d-4386-b7c6-50b252718ca9 from the persistent domain config.
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b71d95ed-728d-4386-b7c6-50b252718ca9 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:24:25 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:25 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:24:25 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:24:25 user nova-compute[82196]:   <serial>65685406-4266-4909-9989-927850da7d53</serial>
Apr 11 19:24:25 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 19:24:25 user nova-compute[82196]: </disk>
Apr 11 19:24:25 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwxtTUrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a49d379e-3976-4d68-b6df-f572a922107c', 'attached_at': '', 'detached_at': '', 'volume_id': '666f5f51-f96b-47f7-9acf-7d0b1c27ecd0', 'serial': '666f5f51-f96b-47f7-9acf-7d0b1c27ecd0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHpNUuhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'a49d379e-3976-4d68-b6df-f572a922107c', 'attached_at': '', 'detached_at': '', 'volume_id': '51e97579-56cc-414f-9a25-3a7c7d045694', 'serial'} {{(pid=82196) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwxtTUrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:25 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:25 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:25 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf260d5-d049-4f94-86f0-c3853bf4c684]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:24:25 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdf6a70-d479-4f7b-a83b-2a81112b1c96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0] added
Apr 11 19:24:25 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca11766-58d1-4180-883a-8aadde29028e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48d8146-26fa-4604-9c1a-e8eb3b3e99e9]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwxtTUrW {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwxtTUrW" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d40f86-b3c8-4741-8a71-047113a8b24e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kwxtTUrW'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f396027-3559-4eb5-b395-bff480d06ef2]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a7fffb-bb14-4ae7-81ed-497abcf37633]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb7b390-b553-4663-b264-b1a5a8aaa014]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0, portal: 172.16.0.220,3260]
Apr 11 19:24:25 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:25 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-deleted-aeb74c01-d96e-4838-8d2c-c2499e3f8770 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Received event network-vif-deleted-db299c0f-eae0-45ae-ba9c-037c50e06a3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Received event network-vif-unplugged-8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Acquiring lock "1ded3918-3bae-465c-a53c-e88011914c50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Lock "1ded3918-3bae-465c-a53c-e88011914c50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Lock "1ded3918-3bae-465c-a53c-e88011914c50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] No waiting events found dispatching network-vif-unplugged-8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Received event network-vif-unplugged-8f590426-373c-4a90-8829-a2ad1a61fcd7 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Received event network-vif-plugged-8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Acquiring lock "1ded3918-3bae-465c-a53c-e88011914c50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Lock "1ded3918-3bae-465c-a53c-e88011914c50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] Lock "1ded3918-3bae-465c-a53c-e88011914c50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] No waiting events found dispatching network-vif-plugged-8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:25 user nova-compute[82196]: WARNING nova.compute.manager [req-320729a9-d58b-4085-bef1-541ade6b0cb7 req-e7163b38-f93e-4a2c-818d-8bb56d16e967 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Received unexpected event network-vif-plugged-8f590426-373c-4a90-8829-a2ad1a61fcd7 for instance with vm_state active and task_state deleting.
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[db432a70-b033-49a2-8acd-ec89a75be62d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a7d043-a02f-4ec5-96ed-4f5760a07307]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:25 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[68465f71-592c-4dac-9182-e6d9c024f232]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwxtTUrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241065.549492, b71d95ed-728d-4386-b7c6-50b252718ca9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:24:25 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Successfully detached device vdb from instance b71d95ed-728d-4386-b7c6-50b252718ca9 from the live domain config.
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cejJuLmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:25 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:25 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Took 0.71 seconds to deallocate network for instance.
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:26 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Deleted allocations for instance 1ded3918-3bae-465c-a53c-e88011914c50
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03023ab6-aa8d-429c-b95e-3b6d1d11e8d1 tempest-AttachSCSIVolumeTestJSON-1532830376 tempest-AttachSCSIVolumeTestJSON-1532830376-project-member] Lock "1ded3918-3bae-465c-a53c-e88011914c50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26464646337363861', 'path': '/dev/sdd'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464646337363861', 'path': '/dev/sdd'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.935s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG nova.objects.instance [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lazy-loading 'flavor' on Instance uuid a49d379e-3976-4d68-b6df-f572a922107c {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43ae5a3-0e00-459c-9fde-319a2d2339bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:26 user nova-compute[82196]: No targets found.
Apr 11 19:24:26 user nova-compute[82196]: iSNS:
Apr 11 19:24:26 user nova-compute[82196]: No targets found.
Apr 11 19:24:26 user nova-compute[82196]: STATIC:
Apr 11 19:24:26 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694
Apr 11 19:24:26 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:26 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:26 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:26 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:26 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:26 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53
Apr 11 19:24:26 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:26 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:26 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0
Apr 11 19:24:26 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:26 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:26 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101
Apr 11 19:24:26 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:26 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:26 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089
Apr 11 19:24:26 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:26 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:26 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013
Apr 11 19:24:26 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:26 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:26 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:26 user nova-compute[82196]: No targets found.
Apr 11 19:24:26 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:26 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:26 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef749d06-8e78-4098-87a9-04d9b153bc34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db9e6f3-f1d7-47ce-acb1-f7b32604a31c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:26 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9281bf0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53'): ({'sdb'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Removing single pathed devices sdb {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d032585a-5f42-419d-adf0-1d09ee91d468]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cb272f-8a51-4658-a98d-6e45d7e13b15]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Flushing IO for device /dev/sdb {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4e9683-cef3-4f00-9242-2540168c8eec]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:26 user nova-compute[82196]: INFO nova.compute.manager [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Took 2.58 seconds to detach 3 volumes for instance.
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f4c559-a1c9-4dbc-be36-aa846c363cf2]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[74975e8e-2652-4041-be1f-073ada16e9c9]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7f814f-f2e4-4419-9c02-acb81a0de074]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53, portal: 172.16.0.220,3260]
Apr 11 19:24:26 user nova-compute[82196]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:26 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65685406-4266-4909-9989-927850da7d53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[74abba98-b76d-4cfd-989e-09fadba7f652]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] <== disconnect_volume: return (1296ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:27 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Deleted allocations for instance dde6b4d2-9288-474c-b400-ce3b6f393b24
Apr 11 19:24:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fd068c2-8d8b-4975-a04f-dbdfd899f2c2 tempest-TaggedBootDevicesTest_v242-1381679461 tempest-TaggedBootDevicesTest_v242-1381679461-project-member] Lock "dde6b4d2-9288-474c-b400-ce3b6f393b24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.419s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 130023424 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG nova.compute.manager [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Received event network-vif-deleted-8f590426-373c-4a90-8829-a2ad1a61fcd7 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG nova.compute.manager [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-changed-59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG nova.compute.manager [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing instance network info cache due to event network-changed-59314c6a-6d9a-4586-a8de-27a566e58eb4. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] Acquiring lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] Acquired lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG nova.network.neutron [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Refreshing network info cache for port 59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG nova.network.neutron [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updated VIF entry in instance network info cache for port 59314c6a-6d9a-4586-a8de-27a566e58eb4. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG nova.network.neutron [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [{"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "address": "fa:16:3e:20:be:ee", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5ae163-b6", "ovs_interfaceid": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6503fe71-75d3-4388-9368-0de318a6d614", "address": "fa:16:3e:a7:f6:07", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6503fe71-75", "ovs_interfaceid": "6503fe71-75d3-4388-9368-0de318a6d614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-75bba134-7408-4de5-9d12-59f3db5dbba9 req-2522676f-fde1-40a2-b0aa-476d009fef50 service nova] Releasing lock "refresh_cache-75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:27 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 130023424 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:28 user nova-compute[82196]: INFO nova.compute.manager [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Terminating instance
Apr 11 19:24:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 208666624 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241053.821698, dde6b4d2-9288-474c-b400-ce3b6f393b24 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:24:28 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] VM Stopped (Lifecycle Event)
Apr 11 19:24:28 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8b3e9b62-42ff-455e-a40e-8839e0f8148f None None] [instance: dde6b4d2-9288-474c-b400-ce3b6f393b24] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-40411a70-65a0-4374-a761-9d33b5883895 req-a1455d22-6b77-483b-939b-95e71b17a618 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-40411a70-65a0-4374-a761-9d33b5883895 req-a1455d22-6b77-483b-939b-95e71b17a618 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-40411a70-65a0-4374-a761-9d33b5883895 req-a1455d22-6b77-483b-939b-95e71b17a618 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-40411a70-65a0-4374-a761-9d33b5883895 req-a1455d22-6b77-483b-939b-95e71b17a618 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-40411a70-65a0-4374-a761-9d33b5883895 req-a1455d22-6b77-483b-939b-95e71b17a618 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-unplugged-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-40411a70-65a0-4374-a761-9d33b5883895 req-a1455d22-6b77-483b-939b-95e71b17a618 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 364904448 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.objects.instance [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lazy-loading 'flavor' on Instance uuid b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c63b9770-3b71-43d9-9593-7ad4a492c7ff tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.220s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 511705088 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "interface-b71d95ed-728d-4386-b7c6-50b252718ca9-8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "interface-b71d95ed-728d-4386-b7c6-50b252718ca9-8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.objects.instance [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lazy-loading 'flavor' on Instance uuid b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-unplugged-59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-59314c6a-6d9a-4586-a8de-27a566e58eb4 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:29 user nova-compute[82196]: WARNING nova.compute.manager [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-59314c6a-6d9a-4586-a8de-27a566e58eb4 for instance with vm_state active and task_state deleting.
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-unplugged-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-efd45e24-0619-48d9-98b1-605a34fe6bf9 req-1875e2e1-c0f5-4f21-84a7-2e1196962a33 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1612946736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1612946736',id=8,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkMpWQuEm1Fv+W/mgY2OYSpggOfZUkoqqxBP4ppJK2h2yfEMM/I7umHLLvv+GHOLnvt+9wKNIfVoID5wNvYw3ZjffzrYq9zAWGLTOYlDtqreEy1EmtTM6C5cfTlcrcO1Q==',key_name='tempest-keypair-1575443570',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f39e7fdf571442b0a6f136020a99f7fb',ramdisk_id='',reservation_id='r-fla1mq5n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1678913086',owner_user_name='tempest-TaggedAttachmentsTest-1678913086-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f84e7cbdf6a4e588753fea907beba0c',uuid=b71d95ed-728d-4386-b7c6-50b252718ca9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converting VIF {"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7,network=Network(e6c6359b-b540-4414-b8d0-150634a2c699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3ff9dd-32') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b5:9d:84"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f3ff9dd-32"/></interface> {{(pid=82196) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b5:9d:84"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f3ff9dd-32"/></interface> {{(pid=82196) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Attempting to detach device tap8f3ff9dd-32 from instance b71d95ed-728d-4386-b7c6-50b252718ca9 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] detach device xml: <interface type="ethernet">
Apr 11 19:24:29 user nova-compute[82196]:   <mac address="fa:16:3e:b5:9d:84"/>
Apr 11 19:24:29 user nova-compute[82196]:   <model type="virtio"/>
Apr 11 19:24:29 user nova-compute[82196]:   <mtu size="1442"/>
Apr 11 19:24:29 user nova-compute[82196]:   <target dev="tap8f3ff9dd-32"/>
Apr 11 19:24:29 user nova-compute[82196]: </interface>
Apr 11 19:24:29 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b5:9d:84"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f3ff9dd-32"/></interface> {{(pid=82196) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b5:9d:84"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f3ff9dd-32"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 11 19:24:29 user nova-compute[82196]:   <name>instance-00000008</name>
Apr 11 19:24:29 user nova-compute[82196]:   <uuid>b71d95ed-728d-4386-b7c6-50b252718ca9</uuid>
Apr 11 19:24:29 user nova-compute[82196]:   <metadata>
Apr 11 19:24:29 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:24:29 user nova-compute[82196]:   <nova:package version="0.0.0"/>
Apr 11 19:24:29 user nova-compute[82196]:   <nova:name>tempest-device-tagging-server-1612946736</nova:name>
Apr 11 19:24:29 user nova-compute[82196]:   <nova:creationTime>2023-04-11 19:24:14</nova:creationTime>
Apr 11 19:24:29 user nova-compute[82196]:   <nova:flavor name="m1.nano">
Apr 11 19:24:29 user nova-compute[82196]:     <nova:memory>128</nova:memory>
Apr 11 19:24:29 user nova-compute[82196]:     <nova:disk>1</nova:disk>
Apr 11 19:24:29 user nova-compute[82196]:     <nova:swap>0</nova:swap>
Apr 11 19:24:29 user nova-compute[82196]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:24:29 user nova-compute[82196]:     <nova:vcpus>1</nova:vcpus>
Apr 11 19:24:29 user nova-compute[82196]:   </nova:flavor>
Apr 11 19:24:29 user nova-compute[82196]:   <nova:owner>
Apr 11 19:24:29 user nova-compute[82196]:     <nova:user uuid="2f84e7cbdf6a4e588753fea907beba0c">tempest-TaggedAttachmentsTest-1678913086-project-member</nova:user>
Apr 11 19:24:29 user nova-compute[82196]:     <nova:project uuid="f39e7fdf571442b0a6f136020a99f7fb">tempest-TaggedAttachmentsTest-1678913086</nova:project>
Apr 11 19:24:29 user nova-compute[82196]:   </nova:owner>
Apr 11 19:24:29 user nova-compute[82196]:   <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:24:29 user nova-compute[82196]:   <nova:ports>
Apr 11 19:24:29 user nova-compute[82196]:     <nova:port uuid="64bd141d-04e6-46e6-bb46-e997d3234fa1">
Apr 11 19:24:29 user nova-compute[82196]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:24:29 user nova-compute[82196]:     </nova:port>
Apr 11 19:24:29 user nova-compute[82196]:     <nova:port uuid="8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7">
Apr 11 19:24:29 user nova-compute[82196]:       <nova:ip type="fixed" address="10.10.10.237" ipVersion="4"/>
Apr 11 19:24:29 user nova-compute[82196]:     </nova:port>
Apr 11 19:24:29 user nova-compute[82196]:   </nova:ports>
Apr 11 19:24:29 user nova-compute[82196]: </nova:instance>
Apr 11 19:24:29 user nova-compute[82196]:   </metadata>
Apr 11 19:24:29 user nova-compute[82196]:   <memory unit='KiB'>131072</memory>
Apr 11 19:24:29 user nova-compute[82196]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 19:24:29 user nova-compute[82196]:   <vcpu placement='static'>1</vcpu>
Apr 11 19:24:29 user nova-compute[82196]:   <resource>
Apr 11 19:24:29 user nova-compute[82196]:     <partition>/machine</partition>
Apr 11 19:24:29 user nova-compute[82196]:   </resource>
Apr 11 19:24:29 user nova-compute[82196]:   <sysinfo type='smbios'>
Apr 11 19:24:29 user nova-compute[82196]:     <system>
Apr 11 19:24:29 user nova-compute[82196]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 19:24:29 user nova-compute[82196]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 19:24:29 user nova-compute[82196]:       <entry name='version'>0.0.0</entry>
Apr 11 19:24:29 user nova-compute[82196]:       <entry name='serial'>b71d95ed-728d-4386-b7c6-50b252718ca9</entry>
Apr 11 19:24:29 user nova-compute[82196]:       <entry name='uuid'>b71d95ed-728d-4386-b7c6-50b252718ca9</entry>
Apr 11 19:24:29 user nova-compute[82196]:       <entry name='family'>Virtual Machine</entry>
Apr 11 19:24:29 user nova-compute[82196]:     </system>
Apr 11 19:24:29 user nova-compute[82196]:   </sysinfo>
Apr 11 19:24:29 user nova-compute[82196]:   <os>
Apr 11 19:24:29 user nova-compute[82196]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 19:24:29 user nova-compute[82196]:     <boot dev='hd'/>
Apr 11 19:24:29 user nova-compute[82196]:     <smbios mode='sysinfo'/>
Apr 11 19:24:29 user nova-compute[82196]:   </os>
Apr 11 19:24:29 user nova-compute[82196]:   <features>
Apr 11 19:24:29 user nova-compute[82196]:     <acpi/>
Apr 11 19:24:29 user nova-compute[82196]:     <apic/>
Apr 11 19:24:29 user nova-compute[82196]:     <vmcoreinfo state='on'/>
Apr 11 19:24:29 user nova-compute[82196]:   </features>
Apr 11 19:24:29 user nova-compute[82196]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 19:24:29 user nova-compute[82196]:     <model fallback='forbid'>Nehalem</model>
Apr 11 19:24:29 user nova-compute[82196]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 19:24:29 user nova-compute[82196]:     <feature policy='require' name='vme'/>
Apr 11 19:24:29 user nova-compute[82196]:     <feature policy='require' name='x2apic'/>
Apr 11 19:24:29 user nova-compute[82196]:     <feature policy='require' name='hypervisor'/>
Apr 11 19:24:29 user nova-compute[82196]:   </cpu>
Apr 11 19:24:29 user nova-compute[82196]:   <clock offset='utc'>
Apr 11 19:24:29 user nova-compute[82196]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 19:24:29 user nova-compute[82196]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 19:24:29 user nova-compute[82196]:     <timer name='hpet' present='no'/>
Apr 11 19:24:29 user nova-compute[82196]:   </clock>
Apr 11 19:24:29 user nova-compute[82196]:   <on_poweroff>destroy</on_poweroff>
Apr 11 19:24:29 user nova-compute[82196]:   <on_reboot>restart</on_reboot>
Apr 11 19:24:29 user nova-compute[82196]:   <on_crash>destroy</on_crash>
Apr 11 19:24:29 user nova-compute[82196]:   <devices>
Apr 11 19:24:29 user nova-compute[82196]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 19:24:29 user nova-compute[82196]:     <disk type='file' device='disk'>
Apr 11 19:24:29 user nova-compute[82196]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 19:24:29 user nova-compute[82196]:       <source file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk' index='2'/>
Apr 11 19:24:29 user nova-compute[82196]:       <backingStore type='file' index='3'>
Apr 11 19:24:29 user nova-compute[82196]:         <format type='raw'/>
Apr 11 19:24:29 user nova-compute[82196]:         <source file='/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9'/>
Apr 11 19:24:29 user nova-compute[82196]:         <backingStore/>
Apr 11 19:24:29 user nova-compute[82196]:       </backingStore>
Apr 11 19:24:29 user nova-compute[82196]:       <target dev='vda' bus='virtio'/>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='virtio-disk0'/>
Apr 11 19:24:29 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 19:24:29 user nova-compute[82196]:     </disk>
Apr 11 19:24:29 user nova-compute[82196]:     <disk type='file' device='cdrom'>
Apr 11 19:24:29 user nova-compute[82196]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 19:24:29 user nova-compute[82196]:       <source file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk.config' index='1'/>
Apr 11 19:24:29 user nova-compute[82196]:       <backingStore/>
Apr 11 19:24:29 user nova-compute[82196]:       <target dev='hda' bus='ide'/>
Apr 11 19:24:29 user nova-compute[82196]:       <readonly/>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='ide0-0-0'/>
Apr 11 19:24:29 user nova-compute[82196]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 19:24:29 user nova-compute[82196]:     </disk>
Apr 11 19:24:29 user nova-compute[82196]:     <controller type='usb' index='0' model='none'>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='usb'/>
Apr 11 19:24:29 user nova-compute[82196]:     </controller>
Apr 11 19:24:29 user nova-compute[82196]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='pci.0'/>
Apr 11 19:24:29 user nova-compute[82196]:     </controller>
Apr 11 19:24:29 user nova-compute[82196]:     <controller type='ide' index='0'>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='ide'/>
Apr 11 19:24:29 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 19:24:29 user nova-compute[82196]:     </controller>
Apr 11 19:24:29 user nova-compute[82196]:     <interface type='ethernet'>
Apr 11 19:24:29 user nova-compute[82196]:       <mac address='fa:16:3e:85:20:b8'/>
Apr 11 19:24:29 user nova-compute[82196]:       <target dev='tap64bd141d-04'/>
Apr 11 19:24:29 user nova-compute[82196]:       <model type='virtio'/>
Apr 11 19:24:29 user nova-compute[82196]:       <mtu size='1442'/>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='net0'/>
Apr 11 19:24:29 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 19:24:29 user nova-compute[82196]:     </interface>
Apr 11 19:24:29 user nova-compute[82196]:     <interface type='ethernet'>
Apr 11 19:24:29 user nova-compute[82196]:       <mac address='fa:16:3e:b5:9d:84'/>
Apr 11 19:24:29 user nova-compute[82196]:       <target dev='tap8f3ff9dd-32'/>
Apr 11 19:24:29 user nova-compute[82196]:       <model type='virtio'/>
Apr 11 19:24:29 user nova-compute[82196]:       <mtu size='1442'/>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='net1'/>
Apr 11 19:24:29 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 11 19:24:29 user nova-compute[82196]:     </interface>
Apr 11 19:24:29 user nova-compute[82196]:     <serial type='pty'>
Apr 11 19:24:29 user nova-compute[82196]:       <source path='/dev/pts/7'/>
Apr 11 19:24:29 user nova-compute[82196]:       <log file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/console.log' append='off'/>
Apr 11 19:24:29 user nova-compute[82196]:       <target type='isa-serial' port='0'>
Apr 11 19:24:29 user nova-compute[82196]:         <model name='isa-serial'/>
Apr 11 19:24:29 user nova-compute[82196]:       </target>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='serial0'/>
Apr 11 19:24:29 user nova-compute[82196]:     </serial>
Apr 11 19:24:29 user nova-compute[82196]:     <console type='pty' tty='/dev/pts/7'>
Apr 11 19:24:29 user nova-compute[82196]:       <source path='/dev/pts/7'/>
Apr 11 19:24:29 user nova-compute[82196]:       <log file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/console.log' append='off'/>
Apr 11 19:24:29 user nova-compute[82196]:       <target type='serial' port='0'/>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='serial0'/>
Apr 11 19:24:29 user nova-compute[82196]:     </console>
Apr 11 19:24:29 user nova-compute[82196]:     <input type='mouse' bus='ps2'>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='input0'/>
Apr 11 19:24:29 user nova-compute[82196]:     </input>
Apr 11 19:24:29 user nova-compute[82196]:     <input type='keyboard' bus='ps2'>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='input1'/>
Apr 11 19:24:29 user nova-compute[82196]:     </input>
Apr 11 19:24:29 user nova-compute[82196]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 11 19:24:29 user nova-compute[82196]:       <listen type='address' address='0.0.0.0'/>
Apr 11 19:24:29 user nova-compute[82196]:     </graphics>
Apr 11 19:24:29 user nova-compute[82196]:     <audio id='1' type='none'/>
Apr 11 19:24:29 user nova-compute[82196]:     <video>
Apr 11 19:24:29 user nova-compute[82196]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='video0'/>
Apr 11 19:24:29 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 19:24:29 user nova-compute[82196]:     </video>
Apr 11 19:24:29 user nova-compute[82196]:     <memballoon model='virtio'>
Apr 11 19:24:29 user nova-compute[82196]:       <stats period='10'/>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='balloon0'/>
Apr 11 19:24:29 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 19:24:29 user nova-compute[82196]:     </memballoon>
Apr 11 19:24:29 user nova-compute[82196]:     <rng model='virtio'>
Apr 11 19:24:29 user nova-compute[82196]:       <backend model='random'>/dev/urandom</backend>
Apr 11 19:24:29 user nova-compute[82196]:       <alias name='rng0'/>
Apr 11 19:24:29 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 19:24:29 user nova-compute[82196]:     </rng>
Apr 11 19:24:29 user nova-compute[82196]:   </devices>
Apr 11 19:24:29 user nova-compute[82196]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 19:24:29 user nova-compute[82196]:     <label>libvirt-b71d95ed-728d-4386-b7c6-50b252718ca9</label>
Apr 11 19:24:29 user nova-compute[82196]:     <imagelabel>libvirt-b71d95ed-728d-4386-b7c6-50b252718ca9</imagelabel>
Apr 11 19:24:29 user nova-compute[82196]:   </seclabel>
Apr 11 19:24:29 user nova-compute[82196]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 19:24:29 user nova-compute[82196]:     <label>+64055:+108</label>
Apr 11 19:24:29 user nova-compute[82196]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 19:24:29 user nova-compute[82196]:   </seclabel>
Apr 11 19:24:29 user nova-compute[82196]: </domain>
Apr 11 19:24:29 user nova-compute[82196]:  {{(pid=82196) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 19:24:29 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Successfully detached device tap8f3ff9dd-32 from instance b71d95ed-728d-4386-b7c6-50b252718ca9 from the persistent domain config.
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] (1/8): Attempting to detach device tap8f3ff9dd-32 with device alias net1 from instance b71d95ed-728d-4386-b7c6-50b252718ca9 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] detach device xml: <interface type="ethernet">
Apr 11 19:24:29 user nova-compute[82196]:   <mac address="fa:16:3e:b5:9d:84"/>
Apr 11 19:24:29 user nova-compute[82196]:   <model type="virtio"/>
Apr 11 19:24:29 user nova-compute[82196]:   <mtu size="1442"/>
Apr 11 19:24:29 user nova-compute[82196]:   <target dev="tap8f3ff9dd-32"/>
Apr 11 19:24:29 user nova-compute[82196]: </interface>
Apr 11 19:24:29 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:24:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 684720128 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:30 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Instance destroyed successfully.
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.objects.instance [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lazy-loading 'resources' on Instance uuid 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:a1:3e,bridge_name='br-int',has_traffic_filtering=True,id=59314c6a-6d9a-4586-a8de-27a566e58eb4,network=Network(92d50449-1a92-4c36-9625-7b6d9326a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59314c6a-6d') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:a1:3e,bridge_name='br-int',has_traffic_filtering=True,id=59314c6a-6d9a-4586-a8de-27a566e58eb4,network=Network(92d50449-1a92-4c36-9625-7b6d9326a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59314c6a-6d') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59314c6a-6d, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241070.2324157, b71d95ed-728d-4386-b7c6-50b252718ca9 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Start waiting for the detach event from libvirt for device tap8f3ff9dd-32 with device alias net1 for instance b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b5:9d:84"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f3ff9dd-32"/></interface> {{(pid=82196) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b5:9d:84"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f3ff9dd-32"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 11 19:24:30 user nova-compute[82196]:   <name>instance-00000008</name>
Apr 11 19:24:30 user nova-compute[82196]:   <uuid>b71d95ed-728d-4386-b7c6-50b252718ca9</uuid>
Apr 11 19:24:30 user nova-compute[82196]:   <metadata>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:24:30 user nova-compute[82196]:   <nova:package version="0.0.0"/>
Apr 11 19:24:30 user nova-compute[82196]:   <nova:name>tempest-device-tagging-server-1612946736</nova:name>
Apr 11 19:24:30 user nova-compute[82196]:   <nova:creationTime>2023-04-11 19:24:14</nova:creationTime>
Apr 11 19:24:30 user nova-compute[82196]:   <nova:flavor name="m1.nano">
Apr 11 19:24:30 user nova-compute[82196]:     <nova:memory>128</nova:memory>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:disk>1</nova:disk>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:swap>0</nova:swap>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:vcpus>1</nova:vcpus>
Apr 11 19:24:30 user nova-compute[82196]:   </nova:flavor>
Apr 11 19:24:30 user nova-compute[82196]:   <nova:owner>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:user uuid="2f84e7cbdf6a4e588753fea907beba0c">tempest-TaggedAttachmentsTest-1678913086-project-member</nova:user>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:project uuid="f39e7fdf571442b0a6f136020a99f7fb">tempest-TaggedAttachmentsTest-1678913086</nova:project>
Apr 11 19:24:30 user nova-compute[82196]:   </nova:owner>
Apr 11 19:24:30 user nova-compute[82196]:   <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:24:30 user nova-compute[82196]:   <nova:ports>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:port uuid="64bd141d-04e6-46e6-bb46-e997d3234fa1">
Apr 11 19:24:30 user nova-compute[82196]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:24:30 user nova-compute[82196]:     </nova:port>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:port uuid="8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7">
Apr 11 19:24:30 user nova-compute[82196]:       <nova:ip type="fixed" address="10.10.10.237" ipVersion="4"/>
Apr 11 19:24:30 user nova-compute[82196]:     </nova:port>
Apr 11 19:24:30 user nova-compute[82196]:   </nova:ports>
Apr 11 19:24:30 user nova-compute[82196]: </nova:instance>
Apr 11 19:24:30 user nova-compute[82196]:   </metadata>
Apr 11 19:24:30 user nova-compute[82196]:   <memory unit='KiB'>131072</memory>
Apr 11 19:24:30 user nova-compute[82196]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 19:24:30 user nova-compute[82196]:   <vcpu placement='static'>1</vcpu>
Apr 11 19:24:30 user nova-compute[82196]:   <resource>
Apr 11 19:24:30 user nova-compute[82196]:     <partition>/machine</partition>
Apr 11 19:24:30 user nova-compute[82196]:   </resource>
Apr 11 19:24:30 user nova-compute[82196]:   <sysinfo type='smbios'>
Apr 11 19:24:30 user nova-compute[82196]:     <system>
Apr 11 19:24:30 user nova-compute[82196]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 19:24:30 user nova-compute[82196]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 19:24:30 user nova-compute[82196]:       <entry name='version'>0.0.0</entry>
Apr 11 19:24:30 user nova-compute[82196]:       <entry name='serial'>b71d95ed-728d-4386-b7c6-50b252718ca9</entry>
Apr 11 19:24:30 user nova-compute[82196]:       <entry name='uuid'>b71d95ed-728d-4386-b7c6-50b252718ca9</entry>
Apr 11 19:24:30 user nova-compute[82196]:       <entry name='family'>Virtual Machine</entry>
Apr 11 19:24:30 user nova-compute[82196]:     </system>
Apr 11 19:24:30 user nova-compute[82196]:   </sysinfo>
Apr 11 19:24:30 user nova-compute[82196]:   <os>
Apr 11 19:24:30 user nova-compute[82196]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 19:24:30 user nova-compute[82196]:     <boot dev='hd'/>
Apr 11 19:24:30 user nova-compute[82196]:     <smbios mode='sysinfo'/>
Apr 11 19:24:30 user nova-compute[82196]:   </os>
Apr 11 19:24:30 user nova-compute[82196]:   <features>
Apr 11 19:24:30 user nova-compute[82196]:     <acpi/>
Apr 11 19:24:30 user nova-compute[82196]:     <apic/>
Apr 11 19:24:30 user nova-compute[82196]:     <vmcoreinfo state='on'/>
Apr 11 19:24:30 user nova-compute[82196]:   </features>
Apr 11 19:24:30 user nova-compute[82196]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 19:24:30 user nova-compute[82196]:     <model fallback='forbid'>Nehalem</model>
Apr 11 19:24:30 user nova-compute[82196]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 19:24:30 user nova-compute[82196]:     <feature policy='require' name='vme'/>
Apr 11 19:24:30 user nova-compute[82196]:     <feature policy='require' name='x2apic'/>
Apr 11 19:24:30 user nova-compute[82196]:     <feature policy='require' name='hypervisor'/>
Apr 11 19:24:30 user nova-compute[82196]:   </cpu>
Apr 11 19:24:30 user nova-compute[82196]:   <clock offset='utc'>
Apr 11 19:24:30 user nova-compute[82196]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 19:24:30 user nova-compute[82196]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 19:24:30 user nova-compute[82196]:     <timer name='hpet' present='no'/>
Apr 11 19:24:30 user nova-compute[82196]:   </clock>
Apr 11 19:24:30 user nova-compute[82196]:   <on_poweroff>destroy</on_poweroff>
Apr 11 19:24:30 user nova-compute[82196]:   <on_reboot>restart</on_reboot>
Apr 11 19:24:30 user nova-compute[82196]:   <on_crash>destroy</on_crash>
Apr 11 19:24:30 user nova-compute[82196]:   <devices>
Apr 11 19:24:30 user nova-compute[82196]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 19:24:30 user nova-compute[82196]:     <disk type='file' device='disk'>
Apr 11 19:24:30 user nova-compute[82196]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 19:24:30 user nova-compute[82196]:       <source file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk' index='2'/>
Apr 11 19:24:30 user nova-compute[82196]:       <backingStore type='file' index='3'>
Apr 11 19:24:30 user nova-compute[82196]:         <format type='raw'/>
Apr 11 19:24:30 user nova-compute[82196]:         <source file='/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9'/>
Apr 11 19:24:30 user nova-compute[82196]:         <backingStore/>
Apr 11 19:24:30 user nova-compute[82196]:       </backingStore>
Apr 11 19:24:30 user nova-compute[82196]:       <target dev='vda' bus='virtio'/>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='virtio-disk0'/>
Apr 11 19:24:30 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 19:24:30 user nova-compute[82196]:     </disk>
Apr 11 19:24:30 user nova-compute[82196]:     <disk type='file' device='cdrom'>
Apr 11 19:24:30 user nova-compute[82196]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 19:24:30 user nova-compute[82196]:       <source file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk.config' index='1'/>
Apr 11 19:24:30 user nova-compute[82196]:       <backingStore/>
Apr 11 19:24:30 user nova-compute[82196]:       <target dev='hda' bus='ide'/>
Apr 11 19:24:30 user nova-compute[82196]:       <readonly/>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='ide0-0-0'/>
Apr 11 19:24:30 user nova-compute[82196]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 19:24:30 user nova-compute[82196]:     </disk>
Apr 11 19:24:30 user nova-compute[82196]:     <controller type='usb' index='0' model='none'>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='usb'/>
Apr 11 19:24:30 user nova-compute[82196]:     </controller>
Apr 11 19:24:30 user nova-compute[82196]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='pci.0'/>
Apr 11 19:24:30 user nova-compute[82196]:     </controller>
Apr 11 19:24:30 user nova-compute[82196]:     <controller type='ide' index='0'>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='ide'/>
Apr 11 19:24:30 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 19:24:30 user nova-compute[82196]:     </controller>
Apr 11 19:24:30 user nova-compute[82196]:     <interface type='ethernet'>
Apr 11 19:24:30 user nova-compute[82196]:       <mac address='fa:16:3e:85:20:b8'/>
Apr 11 19:24:30 user nova-compute[82196]:       <target dev='tap64bd141d-04'/>
Apr 11 19:24:30 user nova-compute[82196]:       <model type='virtio'/>
Apr 11 19:24:30 user nova-compute[82196]:       <mtu size='1442'/>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='net0'/>
Apr 11 19:24:30 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 19:24:30 user nova-compute[82196]:     </interface>
Apr 11 19:24:30 user nova-compute[82196]:     <serial type='pty'>
Apr 11 19:24:30 user nova-compute[82196]:       <source path='/dev/pts/7'/>
Apr 11 19:24:30 user nova-compute[82196]:       <log file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/console.log' append='off'/>
Apr 11 19:24:30 user nova-compute[82196]:       <target type='isa-serial' port='0'>
Apr 11 19:24:30 user nova-compute[82196]:         <model name='isa-serial'/>
Apr 11 19:24:30 user nova-compute[82196]:       </target>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='serial0'/>
Apr 11 19:24:30 user nova-compute[82196]:     </serial>
Apr 11 19:24:30 user nova-compute[82196]:     <console type='pty' tty='/dev/pts/7'>
Apr 11 19:24:30 user nova-compute[82196]:       <source path='/dev/pts/7'/>
Apr 11 19:24:30 user nova-compute[82196]:       <log file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/console.log' append='off'/>
Apr 11 19:24:30 user nova-compute[82196]:       <target type='serial' port='0'/>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='serial0'/>
Apr 11 19:24:30 user nova-compute[82196]:     </console>
Apr 11 19:24:30 user nova-compute[82196]:     <input type='mouse' bus='ps2'>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='input0'/>
Apr 11 19:24:30 user nova-compute[82196]:     </input>
Apr 11 19:24:30 user nova-compute[82196]:     <input type='keyboard' bus='ps2'>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='input1'/>
Apr 11 19:24:30 user nova-compute[82196]:     </input>
Apr 11 19:24:30 user nova-compute[82196]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 11 19:24:30 user nova-compute[82196]:       <listen type='address' address='0.0.0.0'/>
Apr 11 19:24:30 user nova-compute[82196]:     </graphics>
Apr 11 19:24:30 user nova-compute[82196]:     <audio id='1' type='none'/>
Apr 11 19:24:30 user nova-compute[82196]:     <video>
Apr 11 19:24:30 user nova-compute[82196]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='video0'/>
Apr 11 19:24:30 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 19:24:30 user nova-compute[82196]:     </video>
Apr 11 19:24:30 user nova-compute[82196]:     <memballoon model='virtio'>
Apr 11 19:24:30 user nova-compute[82196]:       <stats period='10'/>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='balloon0'/>
Apr 11 19:24:30 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 19:24:30 user nova-compute[82196]:     </memballoon>
Apr 11 19:24:30 user nova-compute[82196]:     <rng model='virtio'>
Apr 11 19:24:30 user nova-compute[82196]:       <backend model='random'>/dev/urandom</backend>
Apr 11 19:24:30 user nova-compute[82196]:       <alias name='rng0'/>
Apr 11 19:24:30 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 19:24:30 user nova-compute[82196]:     </rng>
Apr 11 19:24:30 user nova-compute[82196]:   </devices>
Apr 11 19:24:30 user nova-compute[82196]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 19:24:30 user nova-compute[82196]:     <label>libvirt-b71d95ed-728d-4386-b7c6-50b252718ca9</label>
Apr 11 19:24:30 user nova-compute[82196]:     <imagelabel>libvirt-b71d95ed-728d-4386-b7c6-50b252718ca9</imagelabel>
Apr 11 19:24:30 user nova-compute[82196]:   </seclabel>
Apr 11 19:24:30 user nova-compute[82196]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 19:24:30 user nova-compute[82196]:     <label>+64055:+108</label>
Apr 11 19:24:30 user nova-compute[82196]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 19:24:30 user nova-compute[82196]:   </seclabel>
Apr 11 19:24:30 user nova-compute[82196]: </domain>
Apr 11 19:24:30 user nova-compute[82196]:  {{(pid=82196) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 19:24:30 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Successfully detached device tap8f3ff9dd-32 from instance b71d95ed-728d-4386-b7c6-50b252718ca9 from the live domain config.
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1612946736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1612946736',id=8,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkMpWQuEm1Fv+W/mgY2OYSpggOfZUkoqqxBP4ppJK2h2yfEMM/I7umHLLvv+GHOLnvt+9wKNIfVoID5wNvYw3ZjffzrYq9zAWGLTOYlDtqreEy1EmtTM6C5cfTlcrcO1Q==',key_name='tempest-keypair-1575443570',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f39e7fdf571442b0a6f136020a99f7fb',ramdisk_id='',reservation_id='r-fla1mq5n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1678913086',owner_user_name='tempest-TaggedAttachmentsTest-1678913086-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f84e7cbdf6a4e588753fea907beba0c',uuid=b71d95ed-728d-4386-b7c6-50b252718ca9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converting VIF {"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7,network=Network(e6c6359b-b540-4414-b8d0-150634a2c699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3ff9dd-32') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG os_vif [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7,network=Network(e6c6359b-b540-4414-b8d0-150634a2c699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3ff9dd-32') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f3ff9dd-32, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:30 user nova-compute[82196]: INFO os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:a1:3e,bridge_name='br-int',has_traffic_filtering=True,id=59314c6a-6d9a-4586-a8de-27a566e58eb4,network=Network(92d50449-1a92-4c36-9625-7b6d9326a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59314c6a-6d')
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b1:87,bridge_name='br-int',has_traffic_filtering=True,id=986b85fe-4d6d-4ac6-95c7-02e58e4073b2,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986b85fe-4d') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b1:87,bridge_name='br-int',has_traffic_filtering=True,id=986b85fe-4d6d-4ac6-95c7-02e58e4073b2,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986b85fe-4d') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 836763648 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap986b85fe-4d, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:30 user nova-compute[82196]: INFO os_vif [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7,network=Network(e6c6359b-b540-4414-b8d0-150634a2c699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3ff9dd-32')
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:24:30 user nova-compute[82196]:   <nova:package version="0.0.0"/>
Apr 11 19:24:30 user nova-compute[82196]:   <nova:name>tempest-device-tagging-server-1612946736</nova:name>
Apr 11 19:24:30 user nova-compute[82196]:   <nova:creationTime>2023-04-11 19:24:30</nova:creationTime>
Apr 11 19:24:30 user nova-compute[82196]:   <nova:flavor name="m1.nano">
Apr 11 19:24:30 user nova-compute[82196]:     <nova:memory>128</nova:memory>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:disk>1</nova:disk>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:swap>0</nova:swap>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:vcpus>1</nova:vcpus>
Apr 11 19:24:30 user nova-compute[82196]:   </nova:flavor>
Apr 11 19:24:30 user nova-compute[82196]:   <nova:owner>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:user uuid="2f84e7cbdf6a4e588753fea907beba0c">tempest-TaggedAttachmentsTest-1678913086-project-member</nova:user>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:project uuid="f39e7fdf571442b0a6f136020a99f7fb">tempest-TaggedAttachmentsTest-1678913086</nova:project>
Apr 11 19:24:30 user nova-compute[82196]:   </nova:owner>
Apr 11 19:24:30 user nova-compute[82196]:   <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:24:30 user nova-compute[82196]:   <nova:ports>
Apr 11 19:24:30 user nova-compute[82196]:     <nova:port uuid="64bd141d-04e6-46e6-bb46-e997d3234fa1">
Apr 11 19:24:30 user nova-compute[82196]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:24:30 user nova-compute[82196]:     </nova:port>
Apr 11 19:24:30 user nova-compute[82196]:   </nova:ports>
Apr 11 19:24:30 user nova-compute[82196]: </nova:instance>
Apr 11 19:24:30 user nova-compute[82196]:  {{(pid=82196) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: INFO os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b1:87,bridge_name='br-int',has_traffic_filtering=True,id=986b85fe-4d6d-4ac6-95c7-02e58e4073b2,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986b85fe-4d')
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=f3db6cdb-4d7d-4c66-a809-d59e3feaea97,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3db6cdb-4d') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=f3db6cdb-4d7d-4c66-a809-d59e3feaea97,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3db6cdb-4d') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3db6cdb-4d, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: INFO os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=f3db6cdb-4d7d-4c66-a809-d59e3feaea97,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3db6cdb-4d')
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=cde1df21-a053-49fd-a275-51926ac238e5,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde1df21-a0') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=cde1df21-a053-49fd-a275-51926ac238e5,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde1df21-a0') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcde1df21-a0, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: INFO os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=cde1df21-a053-49fd-a275-51926ac238e5,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde1df21-a0')
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b7ae73d-744e-48fa-af96-b17e7dba1d58,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ae73d-74') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b7ae73d-744e-48fa-af96-b17e7dba1d58,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ae73d-74') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b7ae73d-74, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.compute.manager [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.compute.manager [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:30 user nova-compute[82196]: WARNING nova.compute.manager [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-986b85fe-4d6d-4ac6-95c7-02e58e4073b2 for instance with vm_state active and task_state deleting.
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.compute.manager [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:30 user nova-compute[82196]: DEBUG nova.compute.manager [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-unplugged-1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-1f5ae163-b670-4418-b5d3-1f0b70fdd991 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:31 user nova-compute[82196]: WARNING nova.compute.manager [req-317e5bf2-0ffa-4098-9149-8e418ab337e8 req-bded158a-d35e-4f37-abd9-4d0486943852 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-1f5ae163-b670-4418-b5d3-1f0b70fdd991 for instance with vm_state active and task_state deleting.
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241056.0311155, 8e449d09-f632-4f57-b304-430734096596 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:24:31 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 8e449d09-f632-4f57-b304-430734096596] VM Stopped (Lifecycle Event)
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 994050048 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:31 user nova-compute[82196]: INFO os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b7ae73d-744e-48fa-af96-b17e7dba1d58,network=Network(e93c3f6f-ef1d-4633-9c71-f2da746552cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ae73d-74')
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "address": "fa:16:3e:20:be:ee", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5ae163-b6", "ovs_interfaceid": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "address": "fa:16:3e:20:be:ee", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5ae163-b6", "ovs_interfaceid": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:be:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f5ae163-b670-4418-b5d3-1f0b70fdd991,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5ae163-b6') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:be:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f5ae163-b670-4418-b5d3-1f0b70fdd991,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5ae163-b6') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f5ae163-b6, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bc2c1971-7771-4e89-90d7-68a582566c2d None None] [instance: 8e449d09-f632-4f57-b304-430734096596] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:31 user nova-compute[82196]: INFO os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:be:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f5ae163-b670-4418-b5d3-1f0b70fdd991,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5ae163-b6')
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1561645398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1561645398',id=11,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhE1g6lN7kY56RsSP5k+npFDOjrrGWoXYy12kXywesT1HOw0wtNyAVpyPysT174sgKEO5wRnAMduz6jouZj0JXt1SzaUglpzCVV3eYqUcaSBM8ePS1PhgcYQcrLVnUcQ==',key_name='tempest-keypair-1484668240',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ac81630b23345679b841ea2c3fe28f6',ramdisk_id='',reservation_id='r-cz6qrbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-673790428',owner_user_name='tempest-TaggedBootDevicesTest-673790428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb69b26bc5af47069cdd00b39db75375',uuid=75a4ef96-a6c3-4ccd-9503-bab0d4174b2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6503fe71-75d3-4388-9368-0de318a6d614", "address": "fa:16:3e:a7:f6:07", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6503fe71-75", "ovs_interfaceid": "6503fe71-75d3-4388-9368-0de318a6d614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converting VIF {"id": "6503fe71-75d3-4388-9368-0de318a6d614", "address": "fa:16:3e:a7:f6:07", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6503fe71-75", "ovs_interfaceid": "6503fe71-75d3-4388-9368-0de318a6d614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=6503fe71-75d3-4388-9368-0de318a6d614,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6503fe71-75') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=6503fe71-75d3-4388-9368-0de318a6d614,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6503fe71-75') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6503fe71-75, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:31 user nova-compute[82196]: INFO os_vif [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=6503fe71-75d3-4388-9368-0de318a6d614,network=Network(7b57bb14-73f4-43f0-8934-cbf158c73cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6503fe71-75')
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfVjskwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:31 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[689e2a82-dee3-484c-a5ec-d7162f2527e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:31 user nova-compute[82196]: No targets found.
Apr 11 19:24:31 user nova-compute[82196]: iSNS:
Apr 11 19:24:31 user nova-compute[82196]: No targets found.
Apr 11 19:24:31 user nova-compute[82196]: STATIC:
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:31 user nova-compute[82196]: No targets found.
Apr 11 19:24:31 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:31 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:31 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5f360d-74ba-48b1-b2bf-aa47ce421011]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[607aead8-7b35-4ff4-8792-a4181bdbd883]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927e790280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089'): ({'sde'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Removing single pathed devices sde {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f7b950-2031-403d-894c-088b234f1150]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fd822e-a7cc-4b19-860d-b31d5931e1cd]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Flushing IO for device /dev/sde {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1a15c5-6b3c-41ed-8bb9-eaf8cac2688c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9e467c-6fb8-4d5e-9ce0-b56b846299af]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] SCSI volumes sde have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b9af55-32a0-4097-b492-b75418162609]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3475106f-99a6-4980-aae6-38991176df21]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089, portal: 172.16.0.220,3260]
Apr 11 19:24:31 user nova-compute[82196]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:31 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd6076d-a423-48e8-a9a6-e77019975089 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aa969c-4953-47f2-9870-87463bf3e6b5]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] <== disconnect_volume: return (383ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxiFeMyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:31 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5eb772-10b1-4a19-a01f-e6b4b88736f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:31 user nova-compute[82196]: No targets found.
Apr 11 19:24:31 user nova-compute[82196]: iSNS:
Apr 11 19:24:31 user nova-compute[82196]: No targets found.
Apr 11 19:24:31 user nova-compute[82196]: STATIC:
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:31 user nova-compute[82196]: No targets found.
Apr 11 19:24:31 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:31 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:31 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[12281ce8-404b-4caa-bca7-9025e15d0a66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e4ab4b-ac93-4742-a59d-d8bb38aab943]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:31 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927c01a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101'): ({'sdf'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Removing single pathed devices sdf {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[838831c9-3f2f-48af-9946-67fede485ee0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e63bd-ecf9-4c10-8f37-4757b8b3a924]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Flushing IO for device /dev/sdf {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb1a865-80ad-4bd8-bcaa-9c0d84f21b7e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHpNUuhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:31 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquired lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.network.neutron [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9062b5b5-e85e-4e8d-9741-5f1cba8b0ac0]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] SCSI volumes sdf have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3250cb-2cd9-45d6-bd8c-2a9df720e7a6]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:31 user nova-compute[82196]: WARNING nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-f3db6cdb-4d7d-4c66-a809-d59e3feaea97 for instance with vm_state active and task_state deleting.
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-unplugged-cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-cde1df21-a053-49fd-a275-51926ac238e5 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:31 user nova-compute[82196]: WARNING nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-cde1df21-a053-49fd-a275-51926ac238e5 for instance with vm_state active and task_state deleting.
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-unplugged-8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-8b7ae73d-744e-48fa-af96-b17e7dba1d58 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:31 user nova-compute[82196]: WARNING nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-8b7ae73d-744e-48fa-af96-b17e7dba1d58 for instance with vm_state active and task_state deleting.
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received event network-vif-deleted-8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:31 user nova-compute[82196]: INFO nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Neutron deleted interface 8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7; detaching it from the instance and deleting it from the info cache
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.network.neutron [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Updating instance_info_cache with network_info: [{"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.objects.instance [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lazy-loading 'system_metadata' on Instance uuid b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --logout" returned: 0 in 0.113s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fed13f7-beb1-46e7-a064-7480e396bebb]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101, portal: 172.16.0.220,3260]
Apr 11 19:24:31 user nova-compute[82196]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:31 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc002f3d-0af6-486e-beea-3bcc54a9a101 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[196ca980-a3fb-4224-95c2-86e3be675143]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] <== disconnect_volume: return (405ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.248s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtHVUkvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:31 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.objects.instance [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lazy-loading 'flavor' on Instance uuid b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b38a22f-9fd1-4757-8e6e-9fbccf459447]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:31 user nova-compute[82196]: No targets found.
Apr 11 19:24:31 user nova-compute[82196]: iSNS:
Apr 11 19:24:31 user nova-compute[82196]: No targets found.
Apr 11 19:24:31 user nova-compute[82196]: STATIC:
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013
Apr 11 19:24:31 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:31 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:31 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:31 user nova-compute[82196]: No targets found.
Apr 11 19:24:31 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:31 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:31 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1612946736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1612946736',id=8,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkMpWQuEm1Fv+W/mgY2OYSpggOfZUkoqqxBP4ppJK2h2yfEMM/I7umHLLvv+GHOLnvt+9wKNIfVoID5wNvYw3ZjffzrYq9zAWGLTOYlDtqreEy1EmtTM6C5cfTlcrcO1Q==',key_name='tempest-keypair-1575443570',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f39e7fdf571442b0a6f136020a99f7fb',ramdisk_id='',reservation_id='r-fla1mq5n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1678913086',owner_user_name='tempest-TaggedAttachmentsTest-1678913086-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f84e7cbdf6a4e588753fea907beba0c',uuid=b71d95ed-728d-4386-b7c6-50b252718ca9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.network.os_vif_util [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Converting VIF {"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.network.os_vif_util [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7,network=Network(e6c6359b-b540-4414-b8d0-150634a2c699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3ff9dd-32') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[42497999-0ae5-4d71-8aa6-be487034378d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b5:9d:84"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f3ff9dd-32"/></interface> {{(pid=82196) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b5:9d:84"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f3ff9dd-32"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 11 19:24:31 user nova-compute[82196]:   <name>instance-00000008</name>
Apr 11 19:24:31 user nova-compute[82196]:   <uuid>b71d95ed-728d-4386-b7c6-50b252718ca9</uuid>
Apr 11 19:24:31 user nova-compute[82196]:   <metadata>
Apr 11 19:24:31 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:24:31 user nova-compute[82196]:   <nova:package version="0.0.0"/>
Apr 11 19:24:31 user nova-compute[82196]:   <nova:name>tempest-device-tagging-server-1612946736</nova:name>
Apr 11 19:24:31 user nova-compute[82196]:   <nova:creationTime>2023-04-11 19:24:30</nova:creationTime>
Apr 11 19:24:31 user nova-compute[82196]:   <nova:flavor name="m1.nano">
Apr 11 19:24:31 user nova-compute[82196]:     <nova:memory>128</nova:memory>
Apr 11 19:24:31 user nova-compute[82196]:     <nova:disk>1</nova:disk>
Apr 11 19:24:31 user nova-compute[82196]:     <nova:swap>0</nova:swap>
Apr 11 19:24:31 user nova-compute[82196]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:24:31 user nova-compute[82196]:     <nova:vcpus>1</nova:vcpus>
Apr 11 19:24:31 user nova-compute[82196]:   </nova:flavor>
Apr 11 19:24:31 user nova-compute[82196]:   <nova:owner>
Apr 11 19:24:31 user nova-compute[82196]:     <nova:user uuid="2f84e7cbdf6a4e588753fea907beba0c">tempest-TaggedAttachmentsTest-1678913086-project-member</nova:user>
Apr 11 19:24:31 user nova-compute[82196]:     <nova:project uuid="f39e7fdf571442b0a6f136020a99f7fb">tempest-TaggedAttachmentsTest-1678913086</nova:project>
Apr 11 19:24:31 user nova-compute[82196]:   </nova:owner>
Apr 11 19:24:31 user nova-compute[82196]:   <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:24:31 user nova-compute[82196]:   <nova:ports>
Apr 11 19:24:31 user nova-compute[82196]:     <nova:port uuid="64bd141d-04e6-46e6-bb46-e997d3234fa1">
Apr 11 19:24:31 user nova-compute[82196]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:24:31 user nova-compute[82196]:     </nova:port>
Apr 11 19:24:31 user nova-compute[82196]:   </nova:ports>
Apr 11 19:24:31 user nova-compute[82196]: </nova:instance>
Apr 11 19:24:31 user nova-compute[82196]:   </metadata>
Apr 11 19:24:31 user nova-compute[82196]:   <memory unit='KiB'>131072</memory>
Apr 11 19:24:31 user nova-compute[82196]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 19:24:31 user nova-compute[82196]:   <vcpu placement='static'>1</vcpu>
Apr 11 19:24:31 user nova-compute[82196]:   <resource>
Apr 11 19:24:31 user nova-compute[82196]:     <partition>/machine</partition>
Apr 11 19:24:31 user nova-compute[82196]:   </resource>
Apr 11 19:24:31 user nova-compute[82196]:   <sysinfo type='smbios'>
Apr 11 19:24:31 user nova-compute[82196]:     <system>
Apr 11 19:24:31 user nova-compute[82196]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 19:24:31 user nova-compute[82196]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 19:24:31 user nova-compute[82196]:       <entry name='version'>0.0.0</entry>
Apr 11 19:24:31 user nova-compute[82196]:       <entry name='serial'>b71d95ed-728d-4386-b7c6-50b252718ca9</entry>
Apr 11 19:24:31 user nova-compute[82196]:       <entry name='uuid'>b71d95ed-728d-4386-b7c6-50b252718ca9</entry>
Apr 11 19:24:31 user nova-compute[82196]:       <entry name='family'>Virtual Machine</entry>
Apr 11 19:24:31 user nova-compute[82196]:     </system>
Apr 11 19:24:31 user nova-compute[82196]:   </sysinfo>
Apr 11 19:24:31 user nova-compute[82196]:   <os>
Apr 11 19:24:31 user nova-compute[82196]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 19:24:31 user nova-compute[82196]:     <boot dev='hd'/>
Apr 11 19:24:31 user nova-compute[82196]:     <smbios mode='sysinfo'/>
Apr 11 19:24:31 user nova-compute[82196]:   </os>
Apr 11 19:24:31 user nova-compute[82196]:   <features>
Apr 11 19:24:31 user nova-compute[82196]:     <acpi/>
Apr 11 19:24:31 user nova-compute[82196]:     <apic/>
Apr 11 19:24:31 user nova-compute[82196]:     <vmcoreinfo state='on'/>
Apr 11 19:24:31 user nova-compute[82196]:   </features>
Apr 11 19:24:31 user nova-compute[82196]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 19:24:31 user nova-compute[82196]:     <model fallback='forbid'>Nehalem</model>
Apr 11 19:24:31 user nova-compute[82196]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 19:24:31 user nova-compute[82196]:     <feature policy='require' name='vme'/>
Apr 11 19:24:31 user nova-compute[82196]:     <feature policy='require' name='x2apic'/>
Apr 11 19:24:31 user nova-compute[82196]:     <feature policy='require' name='hypervisor'/>
Apr 11 19:24:31 user nova-compute[82196]:   </cpu>
Apr 11 19:24:31 user nova-compute[82196]:   <clock offset='utc'>
Apr 11 19:24:31 user nova-compute[82196]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 19:24:31 user nova-compute[82196]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 19:24:31 user nova-compute[82196]:     <timer name='hpet' present='no'/>
Apr 11 19:24:31 user nova-compute[82196]:   </clock>
Apr 11 19:24:31 user nova-compute[82196]:   <on_poweroff>destroy</on_poweroff>
Apr 11 19:24:31 user nova-compute[82196]:   <on_reboot>restart</on_reboot>
Apr 11 19:24:31 user nova-compute[82196]:   <on_crash>destroy</on_crash>
Apr 11 19:24:31 user nova-compute[82196]:   <devices>
Apr 11 19:24:31 user nova-compute[82196]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 19:24:31 user nova-compute[82196]:     <disk type='file' device='disk'>
Apr 11 19:24:31 user nova-compute[82196]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 19:24:31 user nova-compute[82196]:       <source file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk' index='2'/>
Apr 11 19:24:31 user nova-compute[82196]:       <backingStore type='file' index='3'>
Apr 11 19:24:31 user nova-compute[82196]:         <format type='raw'/>
Apr 11 19:24:31 user nova-compute[82196]:         <source file='/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9'/>
Apr 11 19:24:31 user nova-compute[82196]:         <backingStore/>
Apr 11 19:24:31 user nova-compute[82196]:       </backingStore>
Apr 11 19:24:31 user nova-compute[82196]:       <target dev='vda' bus='virtio'/>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='virtio-disk0'/>
Apr 11 19:24:31 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 19:24:31 user nova-compute[82196]:     </disk>
Apr 11 19:24:31 user nova-compute[82196]:     <disk type='file' device='cdrom'>
Apr 11 19:24:31 user nova-compute[82196]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 19:24:31 user nova-compute[82196]:       <source file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk.config' index='1'/>
Apr 11 19:24:31 user nova-compute[82196]:       <backingStore/>
Apr 11 19:24:31 user nova-compute[82196]:       <target dev='hda' bus='ide'/>
Apr 11 19:24:31 user nova-compute[82196]:       <readonly/>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='ide0-0-0'/>
Apr 11 19:24:31 user nova-compute[82196]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 19:24:31 user nova-compute[82196]:     </disk>
Apr 11 19:24:31 user nova-compute[82196]:     <controller type='usb' index='0' model='none'>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='usb'/>
Apr 11 19:24:31 user nova-compute[82196]:     </controller>
Apr 11 19:24:31 user nova-compute[82196]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='pci.0'/>
Apr 11 19:24:31 user nova-compute[82196]:     </controller>
Apr 11 19:24:31 user nova-compute[82196]:     <controller type='ide' index='0'>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='ide'/>
Apr 11 19:24:31 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 19:24:31 user nova-compute[82196]:     </controller>
Apr 11 19:24:31 user nova-compute[82196]:     <interface type='ethernet'>
Apr 11 19:24:31 user nova-compute[82196]:       <mac address='fa:16:3e:85:20:b8'/>
Apr 11 19:24:31 user nova-compute[82196]:       <target dev='tap64bd141d-04'/>
Apr 11 19:24:31 user nova-compute[82196]:       <model type='virtio'/>
Apr 11 19:24:31 user nova-compute[82196]:       <mtu size='1442'/>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='net0'/>
Apr 11 19:24:31 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 19:24:31 user nova-compute[82196]:     </interface>
Apr 11 19:24:31 user nova-compute[82196]:     <serial type='pty'>
Apr 11 19:24:31 user nova-compute[82196]:       <source path='/dev/pts/7'/>
Apr 11 19:24:31 user nova-compute[82196]:       <log file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/console.log' append='off'/>
Apr 11 19:24:31 user nova-compute[82196]:       <target type='isa-serial' port='0'>
Apr 11 19:24:31 user nova-compute[82196]:         <model name='isa-serial'/>
Apr 11 19:24:31 user nova-compute[82196]:       </target>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='serial0'/>
Apr 11 19:24:31 user nova-compute[82196]:     </serial>
Apr 11 19:24:31 user nova-compute[82196]:     <console type='pty' tty='/dev/pts/7'>
Apr 11 19:24:31 user nova-compute[82196]:       <source path='/dev/pts/7'/>
Apr 11 19:24:31 user nova-compute[82196]:       <log file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/console.log' append='off'/>
Apr 11 19:24:31 user nova-compute[82196]:       <target type='serial' port='0'/>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='serial0'/>
Apr 11 19:24:31 user nova-compute[82196]:     </console>
Apr 11 19:24:31 user nova-compute[82196]:     <input type='mouse' bus='ps2'>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='input0'/>
Apr 11 19:24:31 user nova-compute[82196]:     </input>
Apr 11 19:24:31 user nova-compute[82196]:     <input type='keyboard' bus='ps2'>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='input1'/>
Apr 11 19:24:31 user nova-compute[82196]:     </input>
Apr 11 19:24:31 user nova-compute[82196]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 11 19:24:31 user nova-compute[82196]:       <listen type='address' address='0.0.0.0'/>
Apr 11 19:24:31 user nova-compute[82196]:     </graphics>
Apr 11 19:24:31 user nova-compute[82196]:     <audio id='1' type='none'/>
Apr 11 19:24:31 user nova-compute[82196]:     <video>
Apr 11 19:24:31 user nova-compute[82196]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='video0'/>
Apr 11 19:24:31 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 19:24:31 user nova-compute[82196]:     </video>
Apr 11 19:24:31 user nova-compute[82196]:     <memballoon model='virtio'>
Apr 11 19:24:31 user nova-compute[82196]:       <stats period='10'/>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='balloon0'/>
Apr 11 19:24:31 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 19:24:31 user nova-compute[82196]:     </memballoon>
Apr 11 19:24:31 user nova-compute[82196]:     <rng model='virtio'>
Apr 11 19:24:31 user nova-compute[82196]:       <backend model='random'>/dev/urandom</backend>
Apr 11 19:24:31 user nova-compute[82196]:       <alias name='rng0'/>
Apr 11 19:24:31 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 19:24:31 user nova-compute[82196]:     </rng>
Apr 11 19:24:31 user nova-compute[82196]:   </devices>
Apr 11 19:24:31 user nova-compute[82196]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 19:24:31 user nova-compute[82196]:     <label>libvirt-b71d95ed-728d-4386-b7c6-50b252718ca9</label>
Apr 11 19:24:31 user nova-compute[82196]:     <imagelabel>libvirt-b71d95ed-728d-4386-b7c6-50b252718ca9</imagelabel>
Apr 11 19:24:31 user nova-compute[82196]:   </seclabel>
Apr 11 19:24:31 user nova-compute[82196]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 19:24:31 user nova-compute[82196]:     <label>+64055:+108</label>
Apr 11 19:24:31 user nova-compute[82196]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 19:24:31 user nova-compute[82196]:   </seclabel>
Apr 11 19:24:31 user nova-compute[82196]: </domain>
Apr 11 19:24:31 user nova-compute[82196]:  {{(pid=82196) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b5:9d:84"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f3ff9dd-32"/></interface> {{(pid=82196) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b5:9d:84"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f3ff9dd-32"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 11 19:24:32 user nova-compute[82196]:   <name>instance-00000008</name>
Apr 11 19:24:32 user nova-compute[82196]:   <uuid>b71d95ed-728d-4386-b7c6-50b252718ca9</uuid>
Apr 11 19:24:32 user nova-compute[82196]:   <metadata>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:24:32 user nova-compute[82196]:   <nova:package version="0.0.0"/>
Apr 11 19:24:32 user nova-compute[82196]:   <nova:name>tempest-device-tagging-server-1612946736</nova:name>
Apr 11 19:24:32 user nova-compute[82196]:   <nova:creationTime>2023-04-11 19:24:30</nova:creationTime>
Apr 11 19:24:32 user nova-compute[82196]:   <nova:flavor name="m1.nano">
Apr 11 19:24:32 user nova-compute[82196]:     <nova:memory>128</nova:memory>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:disk>1</nova:disk>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:swap>0</nova:swap>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:vcpus>1</nova:vcpus>
Apr 11 19:24:32 user nova-compute[82196]:   </nova:flavor>
Apr 11 19:24:32 user nova-compute[82196]:   <nova:owner>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:user uuid="2f84e7cbdf6a4e588753fea907beba0c">tempest-TaggedAttachmentsTest-1678913086-project-member</nova:user>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:project uuid="f39e7fdf571442b0a6f136020a99f7fb">tempest-TaggedAttachmentsTest-1678913086</nova:project>
Apr 11 19:24:32 user nova-compute[82196]:   </nova:owner>
Apr 11 19:24:32 user nova-compute[82196]:   <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:24:32 user nova-compute[82196]:   <nova:ports>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:port uuid="64bd141d-04e6-46e6-bb46-e997d3234fa1">
Apr 11 19:24:32 user nova-compute[82196]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:24:32 user nova-compute[82196]:     </nova:port>
Apr 11 19:24:32 user nova-compute[82196]:   </nova:ports>
Apr 11 19:24:32 user nova-compute[82196]: </nova:instance>
Apr 11 19:24:32 user nova-compute[82196]:   </metadata>
Apr 11 19:24:32 user nova-compute[82196]:   <memory unit='KiB'>131072</memory>
Apr 11 19:24:32 user nova-compute[82196]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 19:24:32 user nova-compute[82196]:   <vcpu placement='static'>1</vcpu>
Apr 11 19:24:32 user nova-compute[82196]:   <resource>
Apr 11 19:24:32 user nova-compute[82196]:     <partition>/machine</partition>
Apr 11 19:24:32 user nova-compute[82196]:   </resource>
Apr 11 19:24:32 user nova-compute[82196]:   <sysinfo type='smbios'>
Apr 11 19:24:32 user nova-compute[82196]:     <system>
Apr 11 19:24:32 user nova-compute[82196]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 19:24:32 user nova-compute[82196]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 19:24:32 user nova-compute[82196]:       <entry name='version'>0.0.0</entry>
Apr 11 19:24:32 user nova-compute[82196]:       <entry name='serial'>b71d95ed-728d-4386-b7c6-50b252718ca9</entry>
Apr 11 19:24:32 user nova-compute[82196]:       <entry name='uuid'>b71d95ed-728d-4386-b7c6-50b252718ca9</entry>
Apr 11 19:24:32 user nova-compute[82196]:       <entry name='family'>Virtual Machine</entry>
Apr 11 19:24:32 user nova-compute[82196]:     </system>
Apr 11 19:24:32 user nova-compute[82196]:   </sysinfo>
Apr 11 19:24:32 user nova-compute[82196]:   <os>
Apr 11 19:24:32 user nova-compute[82196]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 19:24:32 user nova-compute[82196]:     <boot dev='hd'/>
Apr 11 19:24:32 user nova-compute[82196]:     <smbios mode='sysinfo'/>
Apr 11 19:24:32 user nova-compute[82196]:   </os>
Apr 11 19:24:32 user nova-compute[82196]:   <features>
Apr 11 19:24:32 user nova-compute[82196]:     <acpi/>
Apr 11 19:24:32 user nova-compute[82196]:     <apic/>
Apr 11 19:24:32 user nova-compute[82196]:     <vmcoreinfo state='on'/>
Apr 11 19:24:32 user nova-compute[82196]:   </features>
Apr 11 19:24:32 user nova-compute[82196]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 19:24:32 user nova-compute[82196]:     <model fallback='forbid'>Nehalem</model>
Apr 11 19:24:32 user nova-compute[82196]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 19:24:32 user nova-compute[82196]:     <feature policy='require' name='vme'/>
Apr 11 19:24:32 user nova-compute[82196]:     <feature policy='require' name='x2apic'/>
Apr 11 19:24:32 user nova-compute[82196]:     <feature policy='require' name='hypervisor'/>
Apr 11 19:24:32 user nova-compute[82196]:   </cpu>
Apr 11 19:24:32 user nova-compute[82196]:   <clock offset='utc'>
Apr 11 19:24:32 user nova-compute[82196]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 19:24:32 user nova-compute[82196]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 19:24:32 user nova-compute[82196]:     <timer name='hpet' present='no'/>
Apr 11 19:24:32 user nova-compute[82196]:   </clock>
Apr 11 19:24:32 user nova-compute[82196]:   <on_poweroff>destroy</on_poweroff>
Apr 11 19:24:32 user nova-compute[82196]:   <on_reboot>restart</on_reboot>
Apr 11 19:24:32 user nova-compute[82196]:   <on_crash>destroy</on_crash>
Apr 11 19:24:32 user nova-compute[82196]:   <devices>
Apr 11 19:24:32 user nova-compute[82196]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 19:24:32 user nova-compute[82196]:     <disk type='file' device='disk'>
Apr 11 19:24:32 user nova-compute[82196]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 19:24:32 user nova-compute[82196]:       <source file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk' index='2'/>
Apr 11 19:24:32 user nova-compute[82196]:       <backingStore type='file' index='3'>
Apr 11 19:24:32 user nova-compute[82196]:         <format type='raw'/>
Apr 11 19:24:32 user nova-compute[82196]:         <source file='/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9'/>
Apr 11 19:24:32 user nova-compute[82196]:         <backingStore/>
Apr 11 19:24:32 user nova-compute[82196]:       </backingStore>
Apr 11 19:24:32 user nova-compute[82196]:       <target dev='vda' bus='virtio'/>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='virtio-disk0'/>
Apr 11 19:24:32 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 19:24:32 user nova-compute[82196]:     </disk>
Apr 11 19:24:32 user nova-compute[82196]:     <disk type='file' device='cdrom'>
Apr 11 19:24:32 user nova-compute[82196]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 19:24:32 user nova-compute[82196]:       <source file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk.config' index='1'/>
Apr 11 19:24:32 user nova-compute[82196]:       <backingStore/>
Apr 11 19:24:32 user nova-compute[82196]:       <target dev='hda' bus='ide'/>
Apr 11 19:24:32 user nova-compute[82196]:       <readonly/>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='ide0-0-0'/>
Apr 11 19:24:32 user nova-compute[82196]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 19:24:32 user nova-compute[82196]:     </disk>
Apr 11 19:24:32 user nova-compute[82196]:     <controller type='usb' index='0' model='none'>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='usb'/>
Apr 11 19:24:32 user nova-compute[82196]:     </controller>
Apr 11 19:24:32 user nova-compute[82196]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='pci.0'/>
Apr 11 19:24:32 user nova-compute[82196]:     </controller>
Apr 11 19:24:32 user nova-compute[82196]:     <controller type='ide' index='0'>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='ide'/>
Apr 11 19:24:32 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 19:24:32 user nova-compute[82196]:     </controller>
Apr 11 19:24:32 user nova-compute[82196]:     <interface type='ethernet'>
Apr 11 19:24:32 user nova-compute[82196]:       <mac address='fa:16:3e:85:20:b8'/>
Apr 11 19:24:32 user nova-compute[82196]:       <target dev='tap64bd141d-04'/>
Apr 11 19:24:32 user nova-compute[82196]:       <model type='virtio'/>
Apr 11 19:24:32 user nova-compute[82196]:       <mtu size='1442'/>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='net0'/>
Apr 11 19:24:32 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 19:24:32 user nova-compute[82196]:     </interface>
Apr 11 19:24:32 user nova-compute[82196]:     <serial type='pty'>
Apr 11 19:24:32 user nova-compute[82196]:       <source path='/dev/pts/7'/>
Apr 11 19:24:32 user nova-compute[82196]:       <log file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/console.log' append='off'/>
Apr 11 19:24:32 user nova-compute[82196]:       <target type='isa-serial' port='0'>
Apr 11 19:24:32 user nova-compute[82196]:         <model name='isa-serial'/>
Apr 11 19:24:32 user nova-compute[82196]:       </target>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='serial0'/>
Apr 11 19:24:32 user nova-compute[82196]:     </serial>
Apr 11 19:24:32 user nova-compute[82196]:     <console type='pty' tty='/dev/pts/7'>
Apr 11 19:24:32 user nova-compute[82196]:       <source path='/dev/pts/7'/>
Apr 11 19:24:32 user nova-compute[82196]:       <log file='/opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/console.log' append='off'/>
Apr 11 19:24:32 user nova-compute[82196]:       <target type='serial' port='0'/>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='serial0'/>
Apr 11 19:24:32 user nova-compute[82196]:     </console>
Apr 11 19:24:32 user nova-compute[82196]:     <input type='mouse' bus='ps2'>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='input0'/>
Apr 11 19:24:32 user nova-compute[82196]:     </input>
Apr 11 19:24:32 user nova-compute[82196]:     <input type='keyboard' bus='ps2'>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='input1'/>
Apr 11 19:24:32 user nova-compute[82196]:     </input>
Apr 11 19:24:32 user nova-compute[82196]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 11 19:24:32 user nova-compute[82196]:       <listen type='address' address='0.0.0.0'/>
Apr 11 19:24:32 user nova-compute[82196]:     </graphics>
Apr 11 19:24:32 user nova-compute[82196]:     <audio id='1' type='none'/>
Apr 11 19:24:32 user nova-compute[82196]:     <video>
Apr 11 19:24:32 user nova-compute[82196]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='video0'/>
Apr 11 19:24:32 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 19:24:32 user nova-compute[82196]:     </video>
Apr 11 19:24:32 user nova-compute[82196]:     <memballoon model='virtio'>
Apr 11 19:24:32 user nova-compute[82196]:       <stats period='10'/>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='balloon0'/>
Apr 11 19:24:32 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 19:24:32 user nova-compute[82196]:     </memballoon>
Apr 11 19:24:32 user nova-compute[82196]:     <rng model='virtio'>
Apr 11 19:24:32 user nova-compute[82196]:       <backend model='random'>/dev/urandom</backend>
Apr 11 19:24:32 user nova-compute[82196]:       <alias name='rng0'/>
Apr 11 19:24:32 user nova-compute[82196]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 19:24:32 user nova-compute[82196]:     </rng>
Apr 11 19:24:32 user nova-compute[82196]:   </devices>
Apr 11 19:24:32 user nova-compute[82196]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 19:24:32 user nova-compute[82196]:     <label>libvirt-b71d95ed-728d-4386-b7c6-50b252718ca9</label>
Apr 11 19:24:32 user nova-compute[82196]:     <imagelabel>libvirt-b71d95ed-728d-4386-b7c6-50b252718ca9</imagelabel>
Apr 11 19:24:32 user nova-compute[82196]:   </seclabel>
Apr 11 19:24:32 user nova-compute[82196]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 19:24:32 user nova-compute[82196]:     <label>+64055:+108</label>
Apr 11 19:24:32 user nova-compute[82196]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 19:24:32 user nova-compute[82196]:   </seclabel>
Apr 11 19:24:32 user nova-compute[82196]: </domain>
Apr 11 19:24:32 user nova-compute[82196]:  {{(pid=82196) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 19:24:32 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Detaching interface fa:16:3e:b5:9d:84 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap8f3ff9dd-32' not found.
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1612946736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1612946736',id=8,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkMpWQuEm1Fv+W/mgY2OYSpggOfZUkoqqxBP4ppJK2h2yfEMM/I7umHLLvv+GHOLnvt+9wKNIfVoID5wNvYw3ZjffzrYq9zAWGLTOYlDtqreEy1EmtTM6C5cfTlcrcO1Q==',key_name='tempest-keypair-1575443570',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f39e7fdf571442b0a6f136020a99f7fb',ramdisk_id='',reservation_id='r-fla1mq5n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1678913086',owner_user_name='tempest-TaggedAttachmentsTest-1678913086-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f84e7cbdf6a4e588753fea907beba0c',uuid=b71d95ed-728d-4386-b7c6-50b252718ca9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.network.os_vif_util [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Converting VIF {"id": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "address": "fa:16:3e:b5:9d:84", "network": {"id": "e6c6359b-b540-4414-b8d0-150634a2c699", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1001347848", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3ff9dd-32", "ovs_interfaceid": "8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.network.os_vif_util [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7,network=Network(e6c6359b-b540-4414-b8d0-150634a2c699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3ff9dd-32') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_vif [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7,network=Network(e6c6359b-b540-4414-b8d0-150634a2c699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3ff9dd-32') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12853d6-41f0-4d9d-a89a-7be9eb6aca9a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927c019d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694'): ({'sdc'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Removing single pathed devices sdc {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f3ff9dd-32, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:24:32 user nova-compute[82196]: INFO os_vif [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:84,bridge_name='br-int',has_traffic_filtering=True,id=8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7,network=Network(e6c6359b-b540-4414-b8d0-150634a2c699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3ff9dd-32')
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:24:32 user nova-compute[82196]:   <nova:package version="0.0.0"/>
Apr 11 19:24:32 user nova-compute[82196]:   <nova:name>tempest-device-tagging-server-1612946736</nova:name>
Apr 11 19:24:32 user nova-compute[82196]:   <nova:creationTime>2023-04-11 19:24:32</nova:creationTime>
Apr 11 19:24:32 user nova-compute[82196]:   <nova:flavor name="m1.nano">
Apr 11 19:24:32 user nova-compute[82196]:     <nova:memory>128</nova:memory>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:disk>1</nova:disk>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:swap>0</nova:swap>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:vcpus>1</nova:vcpus>
Apr 11 19:24:32 user nova-compute[82196]:   </nova:flavor>
Apr 11 19:24:32 user nova-compute[82196]:   <nova:owner>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:user uuid="2f84e7cbdf6a4e588753fea907beba0c">tempest-TaggedAttachmentsTest-1678913086-project-member</nova:user>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:project uuid="f39e7fdf571442b0a6f136020a99f7fb">tempest-TaggedAttachmentsTest-1678913086</nova:project>
Apr 11 19:24:32 user nova-compute[82196]:   </nova:owner>
Apr 11 19:24:32 user nova-compute[82196]:   <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:24:32 user nova-compute[82196]:   <nova:ports>
Apr 11 19:24:32 user nova-compute[82196]:     <nova:port uuid="64bd141d-04e6-46e6-bb46-e997d3234fa1">
Apr 11 19:24:32 user nova-compute[82196]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:24:32 user nova-compute[82196]:     </nova:port>
Apr 11 19:24:32 user nova-compute[82196]:   </nova:ports>
Apr 11 19:24:32 user nova-compute[82196]: </nova:instance>
Apr 11 19:24:32 user nova-compute[82196]:  {{(pid=82196) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-unplugged-6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-3f649c52-4fa0-47c5-b7fa-62cf00fbd566 req-a5c28243-681f-46ec-a4e4-56aa7d21a279 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-unplugged-6503fe71-75d3-4388-9368-0de318a6d614 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb14a7c1-9935-439c-98c0-43c5228b6579]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acb1d6c-7704-4d93-a7c2-0d5b68937ae8]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Flushing IO for device /dev/sdc {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f49b8a1-de95-4b55-a54a-74d89a7ebcef]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4785310b-05f5-42f9-ba3f-1041058826e9]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e4f9ba-8ba8-4de0-af27-15c93a9a8c6e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b124e5-c00b-4d2d-85aa-db55985aa15a]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260]
Apr 11 19:24:32 user nova-compute[82196]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1c52e2-e2d4-4722-8fe8-f7aa2f2b5753]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] <== disconnect_volume: return (594ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.355s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbd29c9-d1d3-44ae-9549-1504120b49fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:32 user nova-compute[82196]: No targets found.
Apr 11 19:24:32 user nova-compute[82196]: iSNS:
Apr 11 19:24:32 user nova-compute[82196]: No targets found.
Apr 11 19:24:32 user nova-compute[82196]: STATIC:
Apr 11 19:24:32 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:32 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:32 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:32 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0
Apr 11 19:24:32 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:32 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:32 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013
Apr 11 19:24:32 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:32 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:32 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:32 user nova-compute[82196]: No targets found.
Apr 11 19:24:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:32 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:32 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fb847a-9ab7-46f8-8fc9-3bf1a3bbfd5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.compute.manager [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwxtTUrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'a49d379e-3976-4d68-b6df-f572a922107c', 'attached_at': '', 'detached_at': '', 'volume_id': '666f5f51-f96b-47f7-9acf-7d0b1c27ecd0', 'serial'} {{(pid=82196) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.compute.manager [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] swap_volume: removing Cinder connection for volume 51e97579-56cc-414f-9a25-3a7c7d045694 {{(pid=82196) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f7c980-ef74-4baa-85f1-2af71174721d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927c1c88b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013'): ({'sdg'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Removing single pathed devices sdg {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8c0253-e2e4-4a73-bd2c-c15ace765c23]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: INFO nova.network.neutron [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Port 8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.network.neutron [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Updating instance_info_cache with network_info: [{"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecb417d-72c3-4cfb-9962-c4db99bdaf17]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Flushing IO for device /dev/sdg {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Releasing lock "refresh_cache-b71d95ed-728d-4386-b7c6-50b252718ca9" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bea7b5-955c-44f0-a84a-ce36ccf11732]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9913b844-137a-403a-a75f-bb43d1cf1163 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "interface-b71d95ed-728d-4386-b7c6-50b252718ca9-8f3ff9dd-32cc-4b19-b059-4e4e3da4d3a7" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.811s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff8edcc-34d5-47b7-8ed4-110b29c1bda5]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] SCSI volumes sdg have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecb25b6-a66e-41bf-9daa-633c3752dc58]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5202e761-4106-4d7b-bb43-c1c32cc4704c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013, portal: 172.16.0.220,3260]
Apr 11 19:24:32 user nova-compute[82196]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14117830-bcbb-4cbc-966c-8d7f11cbc013 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6652ee68-1e0a-4d6f-b3ca-54c2850fd295]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] <== disconnect_volume: return (668ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:32 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Deleting instance files /opt/stack/data/nova/instances/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b_del
Apr 11 19:24:32 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Deletion of /opt/stack/data/nova/instances/75a4ef96-a6c3-4ccd-9503-bab0d4174b2b_del complete
Apr 11 19:24:32 user nova-compute[82196]: INFO nova.compute.manager [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Took 4.62 seconds to destroy the instance on the hypervisor.
Apr 11 19:24:32 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:24:32 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:24:33 user nova-compute[82196]: DEBUG nova.compute.manager [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] swap_volume: Updating volume 51e97579-56cc-414f-9a25-3a7c7d045694 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "kwxtTUrW", "auth_password": "fzGvUZmChWKFuc", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "666f5f51-f96b-47f7-9acf-7d0b1c27ecd0"}, "status": "reserved", "instance": "a49d379e-3976-4d68-b6df-f572a922107c", "attached_at": "", "detached_at": "", "volume_id": "666f5f51-f96b-47f7-9acf-7d0b1c27ecd0", "serial": "666f5f51-f96b-47f7-9acf-7d0b1c27ecd0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '666f5f51-f96b-47f7-9acf-7d0b1c27ecd0', 'no_device': None, 'attachment_id': '19a1443c-3b68-4396-af08-d9913a2845e4'} {{(pid=82196) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 19:24:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-cb704516-b2b0-4ed6-b783-06f5a4a25120 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "a49d379e-3976-4d68-b6df-f572a922107c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.971s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:33 user nova-compute[82196]: DEBUG nova.compute.manager [req-ec4221d9-c4c5-4106-9e7e-b465d0807c88 req-aec2b563-b58c-4758-a617-e136b8e08c01 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-plugged-6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ec4221d9-c4c5-4106-9e7e-b465d0807c88 req-aec2b563-b58c-4758-a617-e136b8e08c01 service nova] Acquiring lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ec4221d9-c4c5-4106-9e7e-b465d0807c88 req-aec2b563-b58c-4758-a617-e136b8e08c01 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ec4221d9-c4c5-4106-9e7e-b465d0807c88 req-aec2b563-b58c-4758-a617-e136b8e08c01 service nova] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:33 user nova-compute[82196]: DEBUG nova.compute.manager [req-ec4221d9-c4c5-4106-9e7e-b465d0807c88 req-aec2b563-b58c-4758-a617-e136b8e08c01 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] No waiting events found dispatching network-vif-plugged-6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:33 user nova-compute[82196]: WARNING nova.compute.manager [req-ec4221d9-c4c5-4106-9e7e-b465d0807c88 req-aec2b563-b58c-4758-a617-e136b8e08c01 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received unexpected event network-vif-plugged-6503fe71-75d3-4388-9368-0de318a6d614 for instance with vm_state active and task_state deleting.
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Acquiring lock "a49d379e-3976-4d68-b6df-f572a922107c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "a49d379e-3976-4d68-b6df-f572a922107c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG os_brick.utils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c75845-0033-4acb-a80d-65b4b18a7126]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba810eb-7176-490e-874e-04a64835f020]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3753d3f-e263-40af-bc45-e0b3f9013acc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b878d59a-70ba-49a5-bcbc-66d282777fd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:34 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:24:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb1df83-492d-4c76-b7bd-68a816a1c9b1]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG os_brick.utils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:34 user nova-compute[82196]: INFO nova.compute.manager [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Swapping volume 666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 for 51e97579-56cc-414f-9a25-3a7c7d045694
Apr 11 19:24:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-deleted-6503fe71-75d3-4388-9368-0de318a6d614 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:36 user nova-compute[82196]: INFO nova.compute.manager [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Neutron deleted interface 6503fe71-75d3-4388-9368-0de318a6d614; detaching it from the instance and deleting it from the info cache
Apr 11 19:24:36 user nova-compute[82196]: DEBUG nova.network.neutron [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [{"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "address": "fa:16:3e:20:be:ee", "network": {"id": "7b57bb14-73f4-43f0-8934-cbf158c73cbf", "bridge": "br-int", "label": "tempest-device-tagging-net2-579740857", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5ae163-b6", "ovs_interfaceid": "1f5ae163-b670-4418-b5d3-1f0b70fdd991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Detach interface failed, port_id=6503fe71-75d3-4388-9368-0de318a6d614, reason: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:24:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-deleted-1f5ae163-b670-4418-b5d3-1f0b70fdd991 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:36 user nova-compute[82196]: INFO nova.compute.manager [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Neutron deleted interface 1f5ae163-b670-4418-b5d3-1f0b70fdd991; detaching it from the instance and deleting it from the info cache
Apr 11 19:24:36 user nova-compute[82196]: DEBUG nova.network.neutron [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [{"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "address": "fa:16:3e:79:9d:a8", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ae73d-74", "ovs_interfaceid": "8b7ae73d-744e-48fa-af96-b17e7dba1d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Detach interface failed, port_id=1f5ae163-b670-4418-b5d3-1f0b70fdd991, reason: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:24:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-deleted-8b7ae73d-744e-48fa-af96-b17e7dba1d58 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:36 user nova-compute[82196]: INFO nova.compute.manager [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Neutron deleted interface 8b7ae73d-744e-48fa-af96-b17e7dba1d58; detaching it from the instance and deleting it from the info cache
Apr 11 19:24:36 user nova-compute[82196]: DEBUG nova.network.neutron [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [{"id": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "address": "fa:16:3e:b3:a1:3e", "network": {"id": "92d50449-1a92-4c36-9625-7b6d9326a1fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562445512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59314c6a-6d", "ovs_interfaceid": "59314c6a-6d9a-4586-a8de-27a566e58eb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "address": "fa:16:3e:ed:b1:87", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986b85fe-4d", "ovs_interfaceid": "986b85fe-4d6d-4ac6-95c7-02e58e4073b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "address": "fa:16:3e:3b:99:6a", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3db6cdb-4d", "ovs_interfaceid": "f3db6cdb-4d7d-4c66-a809-d59e3feaea97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde1df21-a053-49fd-a275-51926ac238e5", "address": "fa:16:3e:0f:4d:37", "network": {"id": "e93c3f6f-ef1d-4633-9c71-f2da746552cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-463667305", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ac81630b23345679b841ea2c3fe28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde1df21-a0", "ovs_interfaceid": "cde1df21-a053-49fd-a275-51926ac238e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-60c6ff57-a0d8-4ff9-a0a4-a6e06f43fab1 req-156f7671-2c52-49ed-880f-540ba713a80a service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Detach interface failed, port_id=8b7ae73d-744e-48fa-af96-b17e7dba1d58, reason: Instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:24:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:36 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:36 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Took 4.17 seconds to deallocate network for instance.
Apr 11 19:24:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-618540ce-1e69-47b9-8935-61e69c0c864c req-dc8a4590-62df-4015-9375-a54eb78e0223 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-deleted-59314c6a-6d9a-4586-a8de-27a566e58eb4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-618540ce-1e69-47b9-8935-61e69c0c864c req-dc8a4590-62df-4015-9375-a54eb78e0223 service nova] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Received event network-vif-deleted-cde1df21-a053-49fd-a275-51926ac238e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHpNUuhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a49d379e-3976-4d68-b6df-f572a922107c', 'attached_at': '', 'detached_at': '', 'volume_id': '51e97579-56cc-414f-9a25-3a7c7d045694', 'serial': '51e97579-56cc-414f-9a25-3a7c7d045694'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwxtTUrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '666f5f51-f96b-47f7-9acf-7d0b1c27ecd0'}, 'status': 'reserved', 'instance': 'a49d379e-3976-4d68-b6df-f572a922107c', 'attached_at': '', 'detached_at': '', 'volume_id': '666f5f51-f96b-47f7-9acf-7d0b1c27ecd0', 'serial'} {{(pid=82196) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHpNUuhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:38 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:38 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:38 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4281f8e0-5b9d-43ae-8f22-441699231ebc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:24:38 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de1c0ef-b5b7-453f-9c35-7c3fbf229f3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694] added
Apr 11 19:24:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[286aa797-2763-4e37-8c46-4490e41b4970]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c036855-7cd5-4982-a2ec-7ea718608718]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OHpNUuhQ {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OHpNUuhQ" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e260d752-3b35-4a4e-abde-430dea6f5a55]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OHpNUuhQ'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7536467-3edb-4cbe-b1c9-739eb74c2dfb]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc02ed08-4780-4739-b206-8bce2c0fde3f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:38 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:38 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9133df8b-5d3c-44dc-ad13-924afb001f61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260]
Apr 11 19:24:38 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadd664f-4572-4c57-93b5-1fce5295a79d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[243e6aa0-5421-4381-90a5-902e05595563]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:38 user nova-compute[82196]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:38 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:38 user nova-compute[82196]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:38 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44154cd-9ea7-4534-9d9e-9e77b3523092]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:24:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHpNUuhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:24:39 user nova-compute[82196]: INFO nova.compute.manager [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Took 2.34 seconds to detach 3 volumes for instance.
Apr 11 19:24:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:39 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:24:39 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:24:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:39 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Deleted allocations for instance 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b
Apr 11 19:24:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9c16874f-1d7e-40c9-9c45-3e8d0afe6e0e tempest-TaggedBootDevicesTest-673790428 tempest-TaggedBootDevicesTest-673790428-project-member] Lock "75a4ef96-a6c3-4ccd-9503-bab0d4174b2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.686s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:39 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241064.843543, 1ded3918-3bae-465c-a53c-e88011914c50 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:24:39 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] VM Stopped (Lifecycle Event)
Apr 11 19:24:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-70ee1a58-32ed-4511-91ca-f8777fe2c2b1 None None] [instance: 1ded3918-3bae-465c-a53c-e88011914c50] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:24:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23335356432643137', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335356432643137', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:24:39 user nova-compute[82196]: DEBUG nova.objects.instance [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lazy-loading 'flavor' on Instance uuid a49d379e-3976-4d68-b6df-f572a922107c {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 162529280 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:41 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 337641472 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:41 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 536870912 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 722468864 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 875560960 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:24:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:24:42 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:24:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-bed4001c-02c2-4c6b-84c8-61654df66d8b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-bed4001c-02c2-4c6b-84c8-61654df66d8b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:43 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:24:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 1052770304 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:24:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Received event network-changed-93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Refreshing instance network info cache due to event network-changed-93054605-985d-4168-9809-21feb31c1346. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:24:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] Acquiring lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] Acquired lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:43 user nova-compute[82196]: DEBUG nova.network.neutron [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Refreshing network info cache for port 93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwxtTUrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '666f5f51-f96b-47f7-9acf-7d0b1c27ecd0': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:44 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1a5535-81b1-43c8-aa6a-40ecea4260ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:44 user nova-compute[82196]: No targets found.
Apr 11 19:24:44 user nova-compute[82196]: iSNS:
Apr 11 19:24:44 user nova-compute[82196]: No targets found.
Apr 11 19:24:44 user nova-compute[82196]: STATIC:
Apr 11 19:24:44 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694
Apr 11 19:24:44 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:44 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:44 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:44 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:44 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:44 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0
Apr 11 19:24:44 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:44 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:44 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:44 user nova-compute[82196]: No targets found.
Apr 11 19:24:44 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:44 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:44 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[058e8dc9-0aae-4b44-b533-891537e30433]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[148786ce-46a3-4da5-9b2b-361d9349410a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:44 user nova-compute[82196]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:44 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:44 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 (non-flash)
Apr 11 19:24:44 user nova-compute[82196]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:44 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:44 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927c1c8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0'): ({'sdd'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Removing single pathed devices sdd {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb23616b-9dd2-4bf1-86e5-0db9a51eb391]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4647dc87-577d-421c-be13-3e9dc6dcb438]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Flushing IO for device /dev/sdd {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'flavor' on Instance uuid d424f88d-5f82-4cac-aa0f-4f99624bd3e7 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8014386b-e8c2-4bb9-b198-af045a9cfbd8]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e096942-2bb2-4dd4-8035-9c58c3c2cbb8]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Updating instance_info_cache with network_info: [{"id": "b644e09b-afb0-43e7-9773-0df435010320", "address": "fa:16:3e:16:ad:8e", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb644e09b-af", "ovs_interfaceid": "b644e09b-afb0-43e7-9773-0df435010320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07bba75-e035-4114-9182-3d52a203ff7d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-bed4001c-02c2-4c6b-84c8-61654df66d8b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3518e24c-6c14-4e07-a588-ccb6b9f3241b]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0, portal: 172.16.0.220,3260]
Apr 11 19:24:44 user nova-compute[82196]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:44 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca24197-4b7c-4785-a15f-44a8cc8b48ab]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] <== disconnect_volume: return (351ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:44 user nova-compute[82196]: INFO nova.compute.manager [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Attaching volume 6c80ed14-155b-4ad7-94d3-a2f3616e15a1 to /dev/vdb
Apr 11 19:24:44 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHpNUuhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a49d379e-3976-4d68-b6df-f572a922107c', 'attached_at': '', 'detached_at': '', 'volume_id': '51e97579-56cc-414f-9a25-3a7c7d045694', 'serial'} {{(pid=82196) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] swap_volume: removing Cinder connection for volume 666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 {{(pid=82196) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.utils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c0bb13-70a5-4aa3-96a0-5d274e4da669]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2db6f77-521c-4cd1-bb67-ccabe6488352]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aa4325-d62d-4bd8-8974-d8ef1c20e7a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[db20ca0b-703c-4656-9036-41814405ee41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:24:44 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[acec50bc-8966-4f9d-8446-bb57f61f4585]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG os_brick.utils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Updating existing volume attachment record: 17aa91eb-6f93-4ab7-b407-203324e6ca87 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG nova.network.neutron [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Updated VIF entry in instance network info cache for port 93054605-985d-4168-9809-21feb31c1346. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG nova.network.neutron [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Updating instance_info_cache with network_info: [{"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4d21323c-7cc7-4d4e-a23d-4ed1c98d39db req-1ddd2470-7a5c-48a6-803f-22243b8b3989 service nova] Releasing lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241070.0954554, 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:24:45 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] VM Stopped (Lifecycle Event)
Apr 11 19:24:45 user nova-compute[82196]: DEBUG nova.compute.manager [None req-532b905f-b06b-43a0-a73a-c5681c0bcb94 None None] [instance: 75a4ef96-a6c3-4ccd-9503-bab0d4174b2b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] [instance: a49d379e-3976-4d68-b6df-f572a922107c] swap_volume: Updating volume 666f5f51-f96b-47f7-9acf-7d0b1c27ecd0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "OHpNUuhQ", "auth_password": "dbhwgAmDT4N9EI", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "51e97579-56cc-414f-9a25-3a7c7d045694"}, "status": "reserved", "instance": "a49d379e-3976-4d68-b6df-f572a922107c", "attached_at": "", "detached_at": "", "volume_id": "51e97579-56cc-414f-9a25-3a7c7d045694", "serial": "51e97579-56cc-414f-9a25-3a7c7d045694"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '51e97579-56cc-414f-9a25-3a7c7d045694', 'no_device': None, 'attachment_id': '8ae9784e-a19b-4cc2-b8b5-c736ea190a70'} {{(pid=82196) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fc69c446-9d1f-4057-80ca-090575b8f785 tempest-TestVolumeSwap-371271722 tempest-TestVolumeSwap-371271722-project-admin] Lock "a49d379e-3976-4d68-b6df-f572a922107c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.245s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a49d379e-3976-4d68-b6df-f572a922107c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a49d379e-3976-4d68-b6df-f572a922107c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:46 user nova-compute[82196]: INFO nova.compute.manager [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Detaching volume 51e97579-56cc-414f-9a25-3a7c7d045694
Apr 11 19:24:46 user nova-compute[82196]: INFO nova.virt.block_device [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Attempting to driver detach volume 51e97579-56cc-414f-9a25-3a7c7d045694 from mountpoint /dev/vdb
Apr 11 19:24:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Attempting to detach device vdb from instance a49d379e-3976-4d68-b6df-f572a922107c from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:24:46 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:46 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:24:46 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:24:46 user nova-compute[82196]:   <serial>51e97579-56cc-414f-9a25-3a7c7d045694</serial>
Apr 11 19:24:46 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:24:46 user nova-compute[82196]: </disk>
Apr 11 19:24:46 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:46 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Successfully detached device vdb from instance a49d379e-3976-4d68-b6df-f572a922107c from the persistent domain config.
Apr 11 19:24:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a49d379e-3976-4d68-b6df-f572a922107c from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:24:46 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:46 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:24:46 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:24:46 user nova-compute[82196]:   <serial>51e97579-56cc-414f-9a25-3a7c7d045694</serial>
Apr 11 19:24:46 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:24:46 user nova-compute[82196]: </disk>
Apr 11 19:24:46 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241086.9555638, a49d379e-3976-4d68-b6df-f572a922107c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:24:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a49d379e-3976-4d68-b6df-f572a922107c {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:24:46 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Successfully detached device vdb from instance a49d379e-3976-4d68-b6df-f572a922107c from the live domain config.
Apr 11 19:24:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHpNUuhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '51e97579-56cc-414f-9a25-3a7c7d045694': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:47 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9217aa05-f141-4af6-878e-c392ad294aa6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:47 user nova-compute[82196]: No targets found.
Apr 11 19:24:47 user nova-compute[82196]: iSNS:
Apr 11 19:24:47 user nova-compute[82196]: No targets found.
Apr 11 19:24:47 user nova-compute[82196]: STATIC:
Apr 11 19:24:47 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694
Apr 11 19:24:47 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:47 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:47 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:47 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:47 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:47 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:47 user nova-compute[82196]: No targets found.
Apr 11 19:24:47 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:47 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:47 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[894e88a7-1221-472f-b297-66c96953bb33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80a09ed-79ad-46f9-b8ab-a17137e9fc5a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:47 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:47 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 (non-flash)
Apr 11 19:24:47 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:47 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9264122c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694'): ({'sdb'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Removing single pathed devices sdb {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[363633ed-7694-4e0c-9d76-02d3b084674a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8a0a70-7153-4350-8fde-716655807bf6]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Flushing IO for device /dev/sdb {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b36445-0c5b-42e7-9aae-b98e438a6114]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:24:47 user nova-compute[82196]: INFO nova.compute.claims [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Claim successful on node user
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d7313c-b16c-4a89-aea5-74e99120acc8]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a0f7e5-ccd6-4ff1-94b1-23d7cef30edd]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[790d8cfa-9961-416a-8ba8-cf2bf8f1b63e]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260]
Apr 11 19:24:47 user nova-compute[82196]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:47 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e97579-56cc-414f-9a25-3a7c7d045694 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cb04f8-ffe3-4bea-8328-10233bb30338]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.714s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] <== disconnect_volume: return (716ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:47 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:24:47 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:24:47 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7595MB free_disk=26.54288101196289GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:24:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.891s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.351s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:24:48 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bed4001c-02c2-4c6b-84c8-61654df66d8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance a49d379e-3976-4d68-b6df-f572a922107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9941d033-15c2-4069-b9a6-f80840e95a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance b71d95ed-728d-4386-b7c6-50b252718ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 53ccc829-6323-48ec-b63f-9de9bc607456 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6802f099-9236-4c79-a892-2963f1b15b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.policy [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:24:48 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Creating image(s)
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "/opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "/opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "/opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.156s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.objects.instance [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lazy-loading 'flavor' on Instance uuid a49d379e-3976-4d68-b6df-f572a922107c {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-38f3a85d-cd30-4de3-abc6-99a9d1b87fe2 tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a49d379e-3976-4d68-b6df-f572a922107c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.225s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk 1073741824" returned: 0 in 0.066s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEoHqsVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:48 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:48 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:48 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.698s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aad9161-f2bd-4055-a5ce-d5907872be51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:24:48 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8b51b9-89f4-478b-ab19-e5c585202d53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1] added
Apr 11 19:24:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25f1cc8-1f68-481b-b581-9ce3e896fdaa]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8cfa57-0b1b-47e8-abc0-fe281455ce1f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bEoHqsVi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bEoHqsVi" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a1de48-3bf9-4af7-96c3-a3e66bac2529]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bEoHqsVi'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[364f21c9-714d-47e5-9800-38615dbafc5a]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5857b269-f9d6-4661-b63c-4302c964f0d1]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Cannot resize image /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'migration_context' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Ensure instance console log exists: /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Successfully created port: 6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d886a-7ff0-4e2a-8118-a984513a7a2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1, portal: 172.16.0.220,3260]
Apr 11 19:24:49 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:49 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e6e469-962a-44b4-9a39-b2b4539215ac]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[86796569-26fc-4c81-9024-fbaea8023682]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 (non-flash)
Apr 11 19:24:49 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:49 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 (non-flash)
Apr 11 19:24:49 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:49 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2676049-cf3e-4ebb-8888-4e4b885cbed9]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEoHqsVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Successfully updated port: 6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquired lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG nova.compute.manager [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-changed-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG nova.compute.manager [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Refreshing instance network info cache due to event network-changed-6193819b-0c1b-476b-b89e-dbbfc7938fc5. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] Acquiring lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:24:49 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Updating instance_info_cache with network_info: [{"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Releasing lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance network_info: |[{"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] Acquired lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.network.neutron [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Refreshing network info cache for port 6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Start _get_guest_xml network_info=[{"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:24:50 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:24:50 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1133297397',display_name='tempest-AttachVolumeTestJSON-server-1133297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1133297397',id=15,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOPD4tcuauGjUTVAuhtjF6Ujtk7F6BaqU+NEO4mmGMGLvyjwNgcmLISc53y0YOwfDCzVZpJizbGjjXjSyz46Q14bi5LzbNBxPb/IJFa2O26n4+/fWcXb8RJ3mMBruboVA==',key_name='tempest-keypair-1431410116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d886d2ec5fc946b49af3c8ca7c8556c7',ramdisk_id='',reservation_id='r-57smpzsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2144032498',owner_user_name='tempest-AttachVolumeTestJSON-2144032498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31c237e142784bd6aa460d6f1bf33400',uuid=6802f099-9236-4c79-a892-2963f1b15b0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converting VIF {"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'pci_devices' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:24:50 user nova-compute[82196]:   <uuid>6802f099-9236-4c79-a892-2963f1b15b0e</uuid>
Apr 11 19:24:50 user nova-compute[82196]:   <name>instance-0000000f</name>
Apr 11 19:24:50 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:24:50 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:24:50 user nova-compute[82196]:   <metadata>
Apr 11 19:24:50 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:24:50 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:24:50 user nova-compute[82196]:       <nova:name>tempest-AttachVolumeTestJSON-server-1133297397</nova:name>
Apr 11 19:24:50 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:24:50</nova:creationTime>
Apr 11 19:24:50 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:24:50 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:24:50 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:24:50 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:24:50 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:24:50 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:24:50 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:24:50 user nova-compute[82196]:       <nova:owner>
Apr 11 19:24:50 user nova-compute[82196]:         <nova:user uuid="31c237e142784bd6aa460d6f1bf33400">tempest-AttachVolumeTestJSON-2144032498-project-member</nova:user>
Apr 11 19:24:50 user nova-compute[82196]:         <nova:project uuid="d886d2ec5fc946b49af3c8ca7c8556c7">tempest-AttachVolumeTestJSON-2144032498</nova:project>
Apr 11 19:24:50 user nova-compute[82196]:       </nova:owner>
Apr 11 19:24:50 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:24:50 user nova-compute[82196]:       <nova:ports>
Apr 11 19:24:50 user nova-compute[82196]:         <nova:port uuid="6193819b-0c1b-476b-b89e-dbbfc7938fc5">
Apr 11 19:24:50 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 19:24:50 user nova-compute[82196]:         </nova:port>
Apr 11 19:24:50 user nova-compute[82196]:       </nova:ports>
Apr 11 19:24:50 user nova-compute[82196]:     </nova:instance>
Apr 11 19:24:50 user nova-compute[82196]:   </metadata>
Apr 11 19:24:50 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:24:50 user nova-compute[82196]:     <system>
Apr 11 19:24:50 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:24:50 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:24:50 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:24:50 user nova-compute[82196]:       <entry name="serial">6802f099-9236-4c79-a892-2963f1b15b0e</entry>
Apr 11 19:24:50 user nova-compute[82196]:       <entry name="uuid">6802f099-9236-4c79-a892-2963f1b15b0e</entry>
Apr 11 19:24:50 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:24:50 user nova-compute[82196]:     </system>
Apr 11 19:24:50 user nova-compute[82196]:   </sysinfo>
Apr 11 19:24:50 user nova-compute[82196]:   <os>
Apr 11 19:24:50 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:24:50 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:24:50 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:24:50 user nova-compute[82196]:   </os>
Apr 11 19:24:50 user nova-compute[82196]:   <features>
Apr 11 19:24:50 user nova-compute[82196]:     <acpi/>
Apr 11 19:24:50 user nova-compute[82196]:     <apic/>
Apr 11 19:24:50 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:24:50 user nova-compute[82196]:   </features>
Apr 11 19:24:50 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:24:50 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:24:50 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:24:50 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:24:50 user nova-compute[82196]:   </clock>
Apr 11 19:24:50 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:24:50 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:24:50 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:24:50 user nova-compute[82196]:   </cpu>
Apr 11 19:24:50 user nova-compute[82196]:   <devices>
Apr 11 19:24:50 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:24:50 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:24:50 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk"/>
Apr 11 19:24:50 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:24:50 user nova-compute[82196]:     </disk>
Apr 11 19:24:50 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:24:50 user nova-compute[82196]:       <mac address="fa:16:3e:ce:17:72"/>
Apr 11 19:24:50 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:24:50 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:24:50 user nova-compute[82196]:       <target dev="tap6193819b-0c"/>
Apr 11 19:24:50 user nova-compute[82196]:     </interface>
Apr 11 19:24:50 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:24:50 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/console.log" append="off"/>
Apr 11 19:24:50 user nova-compute[82196]:     </serial>
Apr 11 19:24:50 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:24:50 user nova-compute[82196]:     <video>
Apr 11 19:24:50 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:24:50 user nova-compute[82196]:     </video>
Apr 11 19:24:50 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:24:50 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:24:50 user nova-compute[82196]:     </rng>
Apr 11 19:24:50 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:24:50 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:24:50 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:24:50 user nova-compute[82196]:     </memballoon>
Apr 11 19:24:50 user nova-compute[82196]:   </devices>
Apr 11 19:24:50 user nova-compute[82196]: </domain>
Apr 11 19:24:50 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1133297397',display_name='tempest-AttachVolumeTestJSON-server-1133297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1133297397',id=15,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOPD4tcuauGjUTVAuhtjF6Ujtk7F6BaqU+NEO4mmGMGLvyjwNgcmLISc53y0YOwfDCzVZpJizbGjjXjSyz46Q14bi5LzbNBxPb/IJFa2O26n4+/fWcXb8RJ3mMBruboVA==',key_name='tempest-keypair-1431410116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d886d2ec5fc946b49af3c8ca7c8556c7',ramdisk_id='',reservation_id='r-57smpzsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2144032498',owner_user_name='tempest-AttachVolumeTestJSON-2144032498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31c237e142784bd6aa460d6f1bf33400',uuid=6802f099-9236-4c79-a892-2963f1b15b0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converting VIF {"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG os_vif [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6193819b-0c, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6193819b-0c, col_values=(('external_ids', {'iface-id': '6193819b-0c1b-476b-b89e-dbbfc7938fc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:17:72', 'vm-uuid': '6802f099-9236-4c79-a892-2963f1b15b0e'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23631363139663965', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631363139663965', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:50 user nova-compute[82196]: INFO os_vif [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c')
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'flavor' on Instance uuid d424f88d-5f82-4cac-aa0f-4f99624bd3e7 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:24:50 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:50 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:24:50 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:24:50 user nova-compute[82196]:   <serial>6c80ed14-155b-4ad7-94d3-a2f3616e15a1</serial>
Apr 11 19:24:50 user nova-compute[82196]: </disk>
Apr 11 19:24:50 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No VIF found with MAC fa:16:3e:ce:17:72, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.network.neutron [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Updated VIF entry in instance network info cache for port 6193819b-0c1b-476b-b89e-dbbfc7938fc5. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.network.neutron [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Updating instance_info_cache with network_info: [{"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e07c1890-7b00-4222-a03e-f21d9e068787 req-8bbb149c-a45b-405b-97c2-c8897aa0bd1e service nova] Releasing lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] No VIF found with MAC fa:16:3e:84:48:64, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:24:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b69670ea-25e2-4b9f-957a-4f1e4d971c70 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.351s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-906ca546-340d-4c9f-891d-2ca20f4e7d0c req-b04d8cfc-ee20-428c-b267-7088e4df39ec service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-906ca546-340d-4c9f-891d-2ca20f4e7d0c req-b04d8cfc-ee20-428c-b267-7088e4df39ec service nova] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-906ca546-340d-4c9f-891d-2ca20f4e7d0c req-b04d8cfc-ee20-428c-b267-7088e4df39ec service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-906ca546-340d-4c9f-891d-2ca20f4e7d0c req-b04d8cfc-ee20-428c-b267-7088e4df39ec service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-906ca546-340d-4c9f-891d-2ca20f4e7d0c req-b04d8cfc-ee20-428c-b267-7088e4df39ec service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] No waiting events found dispatching network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:52 user nova-compute[82196]: WARNING nova.compute.manager [req-906ca546-340d-4c9f-891d-2ca20f4e7d0c req-b04d8cfc-ee20-428c-b267-7088e4df39ec service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received unexpected event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance with vm_state building and task_state spawning.
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:52 user nova-compute[82196]: INFO nova.compute.manager [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Detaching volume 6c80ed14-155b-4ad7-94d3-a2f3616e15a1
Apr 11 19:24:52 user nova-compute[82196]: INFO nova.virt.block_device [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Attempting to driver detach volume 6c80ed14-155b-4ad7-94d3-a2f3616e15a1 from mountpoint /dev/vdb
Apr 11 19:24:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Attempting to detach device vdb from instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:24:52 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:52 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:24:52 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:24:52 user nova-compute[82196]:   <serial>6c80ed14-155b-4ad7-94d3-a2f3616e15a1</serial>
Apr 11 19:24:52 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:24:52 user nova-compute[82196]: </disk>
Apr 11 19:24:52 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:24:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Successfully detached device vdb from instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 from the persistent domain config.
Apr 11 19:24:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:24:52 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:24:52 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:24:52 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:24:52 user nova-compute[82196]:   <serial>6c80ed14-155b-4ad7-94d3-a2f3616e15a1</serial>
Apr 11 19:24:52 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:24:52 user nova-compute[82196]: </disk>
Apr 11 19:24:52 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241092.686109, d424f88d-5f82-4cac-aa0f-4f99624bd3e7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:24:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Successfully detached device vdb from instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 from the live domain config.
Apr 11 19:24:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEoHqsVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:24:52 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffa8a66-cc64-482e-999a-c2f74d1b26f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:24:52 user nova-compute[82196]: No targets found.
Apr 11 19:24:52 user nova-compute[82196]: iSNS:
Apr 11 19:24:52 user nova-compute[82196]: No targets found.
Apr 11 19:24:52 user nova-compute[82196]: STATIC:
Apr 11 19:24:52 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:24:52 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:52 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:52 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1
Apr 11 19:24:52 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:24:52 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:24:52 user nova-compute[82196]: FIRMWARE:
Apr 11 19:24:52 user nova-compute[82196]: No targets found.
Apr 11 19:24:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:24:52 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:24:52 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[344fa7da-2efc-45bc-9c44-8062fef0274c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa19b886-6481-4085-9dc2-370cee0e3c27]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 (non-flash)
Apr 11 19:24:52 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 (non-flash)
Apr 11 19:24:52 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:24:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927c1d2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1'): ({'sdb'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Removing single pathed devices sdb {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[543332c1-ad41-4b8f-8801-8a29b4c74ac5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5224818-7172-47f1-a161-f8e78a3208df]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Flushing IO for device /dev/sdb {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eed22df-277a-4cb2-8484-82ba585552b1]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.075s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2247bdce-4d59-4c88-b63a-82719b40c768]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af97d91-cbad-40f6-836f-63f85225a616]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[76158a7f-b11c-4782-a259-bfb78d520506]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1, portal: 172.16.0.220,3260]
Apr 11 19:24:52 user nova-compute[82196]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1, portal: 172.16.0.220,3260] successful.
Apr 11 19:24:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c80ed14-155b-4ad7-94d3-a2f3616e15a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9fe292-0059-4e8f-a44a-8db45e6cfe64]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:24:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:24:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] <== disconnect_volume: return (301ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:24:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:24:53 user nova-compute[82196]: DEBUG nova.objects.instance [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'flavor' on Instance uuid d424f88d-5f82-4cac-aa0f-4f99624bd3e7 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:24:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59aabd2e-c00f-4fac-bd90-24c6f639894e tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.713s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241094.0008018, 6802f099-9236-4c79-a892-2963f1b15b0e => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:24:54 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] VM Resumed (Lifecycle Event)
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:24:54 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance spawned successfully.
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:24:54 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241094.006737, 6802f099-9236-4c79-a892-2963f1b15b0e => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:24:54 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] VM Started (Lifecycle Event)
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:24:54 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:24:54 user nova-compute[82196]: INFO nova.compute.manager [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Took 5.80 seconds to spawn the instance on the hypervisor.
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-7c62a8f7-4738-4f6d-a500-9d768cdc0c04 req-64fbabe8-de3c-4aad-af5c-1165799ed566 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7c62a8f7-4738-4f6d-a500-9d768cdc0c04 req-64fbabe8-de3c-4aad-af5c-1165799ed566 service nova] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7c62a8f7-4738-4f6d-a500-9d768cdc0c04 req-64fbabe8-de3c-4aad-af5c-1165799ed566 service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7c62a8f7-4738-4f6d-a500-9d768cdc0c04 req-64fbabe8-de3c-4aad-af5c-1165799ed566 service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-7c62a8f7-4738-4f6d-a500-9d768cdc0c04 req-64fbabe8-de3c-4aad-af5c-1165799ed566 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] No waiting events found dispatching network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:24:54 user nova-compute[82196]: WARNING nova.compute.manager [req-7c62a8f7-4738-4f6d-a500-9d768cdc0c04 req-64fbabe8-de3c-4aad-af5c-1165799ed566 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received unexpected event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance with vm_state building and task_state spawning.
Apr 11 19:24:54 user nova-compute[82196]: INFO nova.compute.manager [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Took 7.04 seconds to build instance.
Apr 11 19:24:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eb5893b-887c-4cb6-8078-667528aabb74 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.147s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:24:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:24:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "ac961841-1fc4-4cec-89bd-8f932270441a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "ac961841-1fc4-4cec-89bd-8f932270441a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:25:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:06 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:25:06 user nova-compute[82196]: INFO nova.compute.claims [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Claim successful on node user
Apr 11 19:25:07 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG nova.network.neutron [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:25:07 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:25:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG nova.policy [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c9641ceb17e4914b1cdf061c5bdc79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543456a70d04d7f8c50f37e64b7ee9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:25:07 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Creating image(s)
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "/opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "/opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk 1073741824" returned: 0 in 0.046s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.128s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:25:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:08 user nova-compute[82196]: DEBUG nova.network.neutron [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Successfully created port: c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:25:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:08 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Cannot resize image /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:25:08 user nova-compute[82196]: DEBUG nova.objects.instance [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lazy-loading 'migration_context' on Instance uuid ac961841-1fc4-4cec-89bd-8f932270441a {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:25:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Ensure instance console log exists: /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:25:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Successfully updated port: c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "refresh_cache-ac961841-1fc4-4cec-89bd-8f932270441a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquired lock "refresh_cache-ac961841-1fc4-4cec-89bd-8f932270441a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.compute.manager [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Received event network-changed-c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.compute.manager [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Refreshing instance network info cache due to event network-changed-c48d7fec-727d-409c-8285-6ae0da5ff14d. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] Acquiring lock "refresh_cache-ac961841-1fc4-4cec-89bd-8f932270441a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Updating instance_info_cache with network_info: [{"id": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "address": "fa:16:3e:05:83:cc", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d7fec-72", "ovs_interfaceid": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Releasing lock "refresh_cache-ac961841-1fc4-4cec-89bd-8f932270441a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Instance network_info: |[{"id": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "address": "fa:16:3e:05:83:cc", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d7fec-72", "ovs_interfaceid": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] Acquired lock "refresh_cache-ac961841-1fc4-4cec-89bd-8f932270441a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.network.neutron [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Refreshing network info cache for port c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Start _get_guest_xml network_info=[{"id": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "address": "fa:16:3e:05:83:cc", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d7fec-72", "ovs_interfaceid": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:25:09 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:25:09 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:25:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1079797334',display_name='tempest-VolumesActionsTest-instance-1079797334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1079797334',id=16,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7543456a70d04d7f8c50f37e64b7ee9c',ramdisk_id='',reservation_id='r-0m7wharo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2124197416',owner_user_name='tempest-VolumesActionsTest-2124197416-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:25:07Z,user_data=None,user_id='7c9641ceb17e4914b1cdf061c5bdc79f',uuid=ac961841-1fc4-4cec-89bd-8f932270441a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "address": "fa:16:3e:05:83:cc", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d7fec-72", "ovs_interfaceid": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Converting VIF {"id": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "address": "fa:16:3e:05:83:cc", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d7fec-72", "ovs_interfaceid": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:83:cc,bridge_name='br-int',has_traffic_filtering=True,id=c48d7fec-727d-409c-8285-6ae0da5ff14d,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d7fec-72') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.objects.instance [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lazy-loading 'pci_devices' on Instance uuid ac961841-1fc4-4cec-89bd-8f932270441a {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:25:09 user nova-compute[82196]:   <uuid>ac961841-1fc4-4cec-89bd-8f932270441a</uuid>
Apr 11 19:25:09 user nova-compute[82196]:   <name>instance-00000010</name>
Apr 11 19:25:09 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:25:09 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:25:09 user nova-compute[82196]:   <metadata>
Apr 11 19:25:09 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:25:09 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:25:09 user nova-compute[82196]:       <nova:name>tempest-VolumesActionsTest-instance-1079797334</nova:name>
Apr 11 19:25:09 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:25:09</nova:creationTime>
Apr 11 19:25:09 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:25:09 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:25:09 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:25:09 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:25:09 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:25:09 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:25:09 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:25:09 user nova-compute[82196]:       <nova:owner>
Apr 11 19:25:09 user nova-compute[82196]:         <nova:user uuid="7c9641ceb17e4914b1cdf061c5bdc79f">tempest-VolumesActionsTest-2124197416-project-member</nova:user>
Apr 11 19:25:09 user nova-compute[82196]:         <nova:project uuid="7543456a70d04d7f8c50f37e64b7ee9c">tempest-VolumesActionsTest-2124197416</nova:project>
Apr 11 19:25:09 user nova-compute[82196]:       </nova:owner>
Apr 11 19:25:09 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:25:09 user nova-compute[82196]:       <nova:ports>
Apr 11 19:25:09 user nova-compute[82196]:         <nova:port uuid="c48d7fec-727d-409c-8285-6ae0da5ff14d">
Apr 11 19:25:09 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 19:25:09 user nova-compute[82196]:         </nova:port>
Apr 11 19:25:09 user nova-compute[82196]:       </nova:ports>
Apr 11 19:25:09 user nova-compute[82196]:     </nova:instance>
Apr 11 19:25:09 user nova-compute[82196]:   </metadata>
Apr 11 19:25:09 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:25:09 user nova-compute[82196]:     <system>
Apr 11 19:25:09 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:25:09 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:25:09 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:25:09 user nova-compute[82196]:       <entry name="serial">ac961841-1fc4-4cec-89bd-8f932270441a</entry>
Apr 11 19:25:09 user nova-compute[82196]:       <entry name="uuid">ac961841-1fc4-4cec-89bd-8f932270441a</entry>
Apr 11 19:25:09 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:25:09 user nova-compute[82196]:     </system>
Apr 11 19:25:09 user nova-compute[82196]:   </sysinfo>
Apr 11 19:25:09 user nova-compute[82196]:   <os>
Apr 11 19:25:09 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:25:09 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:25:09 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:25:09 user nova-compute[82196]:   </os>
Apr 11 19:25:09 user nova-compute[82196]:   <features>
Apr 11 19:25:09 user nova-compute[82196]:     <acpi/>
Apr 11 19:25:09 user nova-compute[82196]:     <apic/>
Apr 11 19:25:09 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:25:09 user nova-compute[82196]:   </features>
Apr 11 19:25:09 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:25:09 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:25:09 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:25:09 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:25:09 user nova-compute[82196]:   </clock>
Apr 11 19:25:09 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:25:09 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:25:09 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:25:09 user nova-compute[82196]:   </cpu>
Apr 11 19:25:09 user nova-compute[82196]:   <devices>
Apr 11 19:25:09 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:25:09 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:25:09 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk"/>
Apr 11 19:25:09 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:25:09 user nova-compute[82196]:     </disk>
Apr 11 19:25:09 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:25:09 user nova-compute[82196]:       <mac address="fa:16:3e:05:83:cc"/>
Apr 11 19:25:09 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:25:09 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:25:09 user nova-compute[82196]:       <target dev="tapc48d7fec-72"/>
Apr 11 19:25:09 user nova-compute[82196]:     </interface>
Apr 11 19:25:09 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:25:09 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/console.log" append="off"/>
Apr 11 19:25:09 user nova-compute[82196]:     </serial>
Apr 11 19:25:09 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:25:09 user nova-compute[82196]:     <video>
Apr 11 19:25:09 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:25:09 user nova-compute[82196]:     </video>
Apr 11 19:25:09 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:25:09 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:25:09 user nova-compute[82196]:     </rng>
Apr 11 19:25:09 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:25:09 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:25:09 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:25:09 user nova-compute[82196]:     </memballoon>
Apr 11 19:25:09 user nova-compute[82196]:   </devices>
Apr 11 19:25:09 user nova-compute[82196]: </domain>
Apr 11 19:25:09 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:25:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1079797334',display_name='tempest-VolumesActionsTest-instance-1079797334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1079797334',id=16,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7543456a70d04d7f8c50f37e64b7ee9c',ramdisk_id='',reservation_id='r-0m7wharo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2124197416',owner_user_name='tempest-VolumesActionsTest-2124197416-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:25:07Z,user_data=None,user_id='7c9641ceb17e4914b1cdf061c5bdc79f',uuid=ac961841-1fc4-4cec-89bd-8f932270441a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "address": "fa:16:3e:05:83:cc", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d7fec-72", "ovs_interfaceid": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Converting VIF {"id": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "address": "fa:16:3e:05:83:cc", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d7fec-72", "ovs_interfaceid": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:83:cc,bridge_name='br-int',has_traffic_filtering=True,id=c48d7fec-727d-409c-8285-6ae0da5ff14d,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d7fec-72') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG os_vif [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:83:cc,bridge_name='br-int',has_traffic_filtering=True,id=c48d7fec-727d-409c-8285-6ae0da5ff14d,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d7fec-72') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc48d7fec-72, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc48d7fec-72, col_values=(('external_ids', {'iface-id': 'c48d7fec-727d-409c-8285-6ae0da5ff14d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:83:cc', 'vm-uuid': 'ac961841-1fc4-4cec-89bd-8f932270441a'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:09 user nova-compute[82196]: INFO os_vif [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:83:cc,bridge_name='br-int',has_traffic_filtering=True,id=c48d7fec-727d-409c-8285-6ae0da5ff14d,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d7fec-72')
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] No VIF found with MAC fa:16:3e:05:83:cc, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "083108da-0a96-4177-8866-66131d77c39b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "083108da-0a96-4177-8866-66131d77c39b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.network.neutron [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Updated VIF entry in instance network info cache for port c48d7fec-727d-409c-8285-6ae0da5ff14d. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.network.neutron [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Updating instance_info_cache with network_info: [{"id": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "address": "fa:16:3e:05:83:cc", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d7fec-72", "ovs_interfaceid": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-304f0ad9-afa3-429c-aec5-3d389ae8d60a req-aae54e93-71af-44d7-b22d-4b061deb4714 service nova] Releasing lock "refresh_cache-ac961841-1fc4-4cec-89bd-8f932270441a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:25:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:25:09 user nova-compute[82196]: INFO nova.compute.claims [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Claim successful on node user
Apr 11 19:25:10 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:25:10 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:25:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:25:10 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Creating image(s)
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "/opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "/opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "/opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG nova.policy [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54b4a383f04d4269a0099a738e14807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f153e6b272924b8fa0ef28fb5f0970bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.150s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk 1073741824" returned: 0 in 0.052s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Checking if we can resize image /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Cannot resize image /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG nova.objects.instance [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lazy-loading 'migration_context' on Instance uuid 083108da-0a96-4177-8866-66131d77c39b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Ensure instance console log exists: /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-22c66e5a-7616-489f-a0bd-f797e1c8a6bf req-a826c9a1-2d06-4fea-b7ae-f144dc26c070 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Received event network-vif-plugged-c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-22c66e5a-7616-489f-a0bd-f797e1c8a6bf req-a826c9a1-2d06-4fea-b7ae-f144dc26c070 service nova] Acquiring lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-22c66e5a-7616-489f-a0bd-f797e1c8a6bf req-a826c9a1-2d06-4fea-b7ae-f144dc26c070 service nova] Lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-22c66e5a-7616-489f-a0bd-f797e1c8a6bf req-a826c9a1-2d06-4fea-b7ae-f144dc26c070 service nova] Lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-22c66e5a-7616-489f-a0bd-f797e1c8a6bf req-a826c9a1-2d06-4fea-b7ae-f144dc26c070 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] No waiting events found dispatching network-vif-plugged-c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:11 user nova-compute[82196]: WARNING nova.compute.manager [req-22c66e5a-7616-489f-a0bd-f797e1c8a6bf req-a826c9a1-2d06-4fea-b7ae-f144dc26c070 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Received unexpected event network-vif-plugged-c48d7fec-727d-409c-8285-6ae0da5ff14d for instance with vm_state building and task_state spawning.
Apr 11 19:25:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:12 user nova-compute[82196]: DEBUG nova.network.neutron [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Successfully created port: 44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241113.073907, ac961841-1fc4-4cec-89bd-8f932270441a => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:25:13 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] VM Resumed (Lifecycle Event)
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:25:13 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Instance spawned successfully.
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:13 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241113.0747085, ac961841-1fc4-4cec-89bd-8f932270441a => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:25:13 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] VM Started (Lifecycle Event)
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:25:13 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:25:13 user nova-compute[82196]: INFO nova.compute.manager [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Took 5.77 seconds to spawn the instance on the hypervisor.
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:13 user nova-compute[82196]: INFO nova.compute.manager [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Took 6.58 seconds to build instance.
Apr 11 19:25:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-80a61453-e6e8-432a-b514-c7d283feccbd tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "ac961841-1fc4-4cec-89bd-8f932270441a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.669s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.network.neutron [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Successfully updated port: 44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "refresh_cache-083108da-0a96-4177-8866-66131d77c39b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquired lock "refresh_cache-083108da-0a96-4177-8866-66131d77c39b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.network.neutron [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Received event network-vif-plugged-c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] Acquiring lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] Lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] Lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] No waiting events found dispatching network-vif-plugged-c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:13 user nova-compute[82196]: WARNING nova.compute.manager [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Received unexpected event network-vif-plugged-c48d7fec-727d-409c-8285-6ae0da5ff14d for instance with vm_state active and task_state None.
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Received event network-changed-44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Refreshing instance network info cache due to event network-changed-44671174-415b-41e7-964a-8c37ccb6a82d. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] Acquiring lock "refresh_cache-083108da-0a96-4177-8866-66131d77c39b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:25:13 user nova-compute[82196]: DEBUG nova.network.neutron [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.network.neutron [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Updating instance_info_cache with network_info: [{"id": "44671174-415b-41e7-964a-8c37ccb6a82d", "address": "fa:16:3e:63:17:bc", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44671174-41", "ovs_interfaceid": "44671174-415b-41e7-964a-8c37ccb6a82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Releasing lock "refresh_cache-083108da-0a96-4177-8866-66131d77c39b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Instance network_info: |[{"id": "44671174-415b-41e7-964a-8c37ccb6a82d", "address": "fa:16:3e:63:17:bc", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44671174-41", "ovs_interfaceid": "44671174-415b-41e7-964a-8c37ccb6a82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] Acquired lock "refresh_cache-083108da-0a96-4177-8866-66131d77c39b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.network.neutron [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Refreshing network info cache for port 44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Start _get_guest_xml network_info=[{"id": "44671174-415b-41e7-964a-8c37ccb6a82d", "address": "fa:16:3e:63:17:bc", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44671174-41", "ovs_interfaceid": "44671174-415b-41e7-964a-8c37ccb6a82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:25:14 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:25:14 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-522187297',display_name='tempest-VolumesAdminNegativeTest-server-522187297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-522187297',id=17,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f153e6b272924b8fa0ef28fb5f0970bb',ramdisk_id='',reservation_id='r-frdj9h73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1308264816',owner_user_name='tempest-VolumesAdminNegativeTest-1308264816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:25:11Z,user_data=None,user_id='54b4a383f04d4269a0099a738e14807e',uuid=083108da-0a96-4177-8866-66131d77c39b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44671174-415b-41e7-964a-8c37ccb6a82d", "address": "fa:16:3e:63:17:bc", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44671174-41", "ovs_interfaceid": "44671174-415b-41e7-964a-8c37ccb6a82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Converting VIF {"id": "44671174-415b-41e7-964a-8c37ccb6a82d", "address": "fa:16:3e:63:17:bc", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44671174-41", "ovs_interfaceid": "44671174-415b-41e7-964a-8c37ccb6a82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:17:bc,bridge_name='br-int',has_traffic_filtering=True,id=44671174-415b-41e7-964a-8c37ccb6a82d,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44671174-41') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.objects.instance [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lazy-loading 'pci_devices' on Instance uuid 083108da-0a96-4177-8866-66131d77c39b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:25:14 user nova-compute[82196]:   <uuid>083108da-0a96-4177-8866-66131d77c39b</uuid>
Apr 11 19:25:14 user nova-compute[82196]:   <name>instance-00000011</name>
Apr 11 19:25:14 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:25:14 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:25:14 user nova-compute[82196]:   <metadata>
Apr 11 19:25:14 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:25:14 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:25:14 user nova-compute[82196]:       <nova:name>tempest-VolumesAdminNegativeTest-server-522187297</nova:name>
Apr 11 19:25:14 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:25:14</nova:creationTime>
Apr 11 19:25:14 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:25:14 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:25:14 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:25:14 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:25:14 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:25:14 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:25:14 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:25:14 user nova-compute[82196]:       <nova:owner>
Apr 11 19:25:14 user nova-compute[82196]:         <nova:user uuid="54b4a383f04d4269a0099a738e14807e">tempest-VolumesAdminNegativeTest-1308264816-project-member</nova:user>
Apr 11 19:25:14 user nova-compute[82196]:         <nova:project uuid="f153e6b272924b8fa0ef28fb5f0970bb">tempest-VolumesAdminNegativeTest-1308264816</nova:project>
Apr 11 19:25:14 user nova-compute[82196]:       </nova:owner>
Apr 11 19:25:14 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:25:14 user nova-compute[82196]:       <nova:ports>
Apr 11 19:25:14 user nova-compute[82196]:         <nova:port uuid="44671174-415b-41e7-964a-8c37ccb6a82d">
Apr 11 19:25:14 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 19:25:14 user nova-compute[82196]:         </nova:port>
Apr 11 19:25:14 user nova-compute[82196]:       </nova:ports>
Apr 11 19:25:14 user nova-compute[82196]:     </nova:instance>
Apr 11 19:25:14 user nova-compute[82196]:   </metadata>
Apr 11 19:25:14 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:25:14 user nova-compute[82196]:     <system>
Apr 11 19:25:14 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:25:14 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:25:14 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:25:14 user nova-compute[82196]:       <entry name="serial">083108da-0a96-4177-8866-66131d77c39b</entry>
Apr 11 19:25:14 user nova-compute[82196]:       <entry name="uuid">083108da-0a96-4177-8866-66131d77c39b</entry>
Apr 11 19:25:14 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:25:14 user nova-compute[82196]:     </system>
Apr 11 19:25:14 user nova-compute[82196]:   </sysinfo>
Apr 11 19:25:14 user nova-compute[82196]:   <os>
Apr 11 19:25:14 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:25:14 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:25:14 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:25:14 user nova-compute[82196]:   </os>
Apr 11 19:25:14 user nova-compute[82196]:   <features>
Apr 11 19:25:14 user nova-compute[82196]:     <acpi/>
Apr 11 19:25:14 user nova-compute[82196]:     <apic/>
Apr 11 19:25:14 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:25:14 user nova-compute[82196]:   </features>
Apr 11 19:25:14 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:25:14 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:25:14 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:25:14 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:25:14 user nova-compute[82196]:   </clock>
Apr 11 19:25:14 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:25:14 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:25:14 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:25:14 user nova-compute[82196]:   </cpu>
Apr 11 19:25:14 user nova-compute[82196]:   <devices>
Apr 11 19:25:14 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:25:14 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:25:14 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk"/>
Apr 11 19:25:14 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:25:14 user nova-compute[82196]:     </disk>
Apr 11 19:25:14 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:25:14 user nova-compute[82196]:       <mac address="fa:16:3e:63:17:bc"/>
Apr 11 19:25:14 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:25:14 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:25:14 user nova-compute[82196]:       <target dev="tap44671174-41"/>
Apr 11 19:25:14 user nova-compute[82196]:     </interface>
Apr 11 19:25:14 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:25:14 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/console.log" append="off"/>
Apr 11 19:25:14 user nova-compute[82196]:     </serial>
Apr 11 19:25:14 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:25:14 user nova-compute[82196]:     <video>
Apr 11 19:25:14 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:25:14 user nova-compute[82196]:     </video>
Apr 11 19:25:14 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:25:14 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:25:14 user nova-compute[82196]:     </rng>
Apr 11 19:25:14 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:25:14 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:25:14 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:25:14 user nova-compute[82196]:     </memballoon>
Apr 11 19:25:14 user nova-compute[82196]:   </devices>
Apr 11 19:25:14 user nova-compute[82196]: </domain>
Apr 11 19:25:14 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-522187297',display_name='tempest-VolumesAdminNegativeTest-server-522187297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-522187297',id=17,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f153e6b272924b8fa0ef28fb5f0970bb',ramdisk_id='',reservation_id='r-frdj9h73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1308264816',owner_user_name='tempest-VolumesAdminNegativeTest-1308264816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:25:11Z,user_data=None,user_id='54b4a383f04d4269a0099a738e14807e',uuid=083108da-0a96-4177-8866-66131d77c39b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44671174-415b-41e7-964a-8c37ccb6a82d", "address": "fa:16:3e:63:17:bc", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44671174-41", "ovs_interfaceid": "44671174-415b-41e7-964a-8c37ccb6a82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Converting VIF {"id": "44671174-415b-41e7-964a-8c37ccb6a82d", "address": "fa:16:3e:63:17:bc", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44671174-41", "ovs_interfaceid": "44671174-415b-41e7-964a-8c37ccb6a82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:17:bc,bridge_name='br-int',has_traffic_filtering=True,id=44671174-415b-41e7-964a-8c37ccb6a82d,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44671174-41') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG os_vif [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:17:bc,bridge_name='br-int',has_traffic_filtering=True,id=44671174-415b-41e7-964a-8c37ccb6a82d,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44671174-41') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44671174-41, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44671174-41, col_values=(('external_ids', {'iface-id': '44671174-415b-41e7-964a-8c37ccb6a82d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:17:bc', 'vm-uuid': '083108da-0a96-4177-8866-66131d77c39b'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:14 user nova-compute[82196]: INFO os_vif [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:17:bc,bridge_name='br-int',has_traffic_filtering=True,id=44671174-415b-41e7-964a-8c37ccb6a82d,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44671174-41')
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] No VIF found with MAC fa:16:3e:63:17:bc, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.network.neutron [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Updated VIF entry in instance network info cache for port 44671174-415b-41e7-964a-8c37ccb6a82d. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG nova.network.neutron [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Updating instance_info_cache with network_info: [{"id": "44671174-415b-41e7-964a-8c37ccb6a82d", "address": "fa:16:3e:63:17:bc", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44671174-41", "ovs_interfaceid": "44671174-415b-41e7-964a-8c37ccb6a82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-af43d2b0-f88f-4b6f-b986-449a46d2a6bb req-79137981-4f60-416c-ab44-a32fd877998b service nova] Releasing lock "refresh_cache-083108da-0a96-4177-8866-66131d77c39b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:25:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:16 user nova-compute[82196]: DEBUG nova.compute.manager [req-58af6902-1274-48b6-9d85-474ced3e2fc1 req-7b1a2fb0-651c-4ce9-bb57-b314f7e331e6 service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Received event network-vif-plugged-44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-58af6902-1274-48b6-9d85-474ced3e2fc1 req-7b1a2fb0-651c-4ce9-bb57-b314f7e331e6 service nova] Acquiring lock "083108da-0a96-4177-8866-66131d77c39b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-58af6902-1274-48b6-9d85-474ced3e2fc1 req-7b1a2fb0-651c-4ce9-bb57-b314f7e331e6 service nova] Lock "083108da-0a96-4177-8866-66131d77c39b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-58af6902-1274-48b6-9d85-474ced3e2fc1 req-7b1a2fb0-651c-4ce9-bb57-b314f7e331e6 service nova] Lock "083108da-0a96-4177-8866-66131d77c39b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:16 user nova-compute[82196]: DEBUG nova.compute.manager [req-58af6902-1274-48b6-9d85-474ced3e2fc1 req-7b1a2fb0-651c-4ce9-bb57-b314f7e331e6 service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] No waiting events found dispatching network-vif-plugged-44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:16 user nova-compute[82196]: WARNING nova.compute.manager [req-58af6902-1274-48b6-9d85-474ced3e2fc1 req-7b1a2fb0-651c-4ce9-bb57-b314f7e331e6 service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Received unexpected event network-vif-plugged-44671174-415b-41e7-964a-8c37ccb6a82d for instance with vm_state building and task_state spawning.
Apr 11 19:25:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241118.1928403, 083108da-0a96-4177-8866-66131d77c39b => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:25:18 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 083108da-0a96-4177-8866-66131d77c39b] VM Resumed (Lifecycle Event)
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:25:18 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 083108da-0a96-4177-8866-66131d77c39b] Instance spawned successfully.
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 083108da-0a96-4177-8866-66131d77c39b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.compute.manager [req-03bedef0-76ae-4789-8713-f7ad48495788 req-38c46521-c343-47ca-8f75-e90f70f72b42 service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Received event network-vif-plugged-44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-03bedef0-76ae-4789-8713-f7ad48495788 req-38c46521-c343-47ca-8f75-e90f70f72b42 service nova] Acquiring lock "083108da-0a96-4177-8866-66131d77c39b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-03bedef0-76ae-4789-8713-f7ad48495788 req-38c46521-c343-47ca-8f75-e90f70f72b42 service nova] Lock "083108da-0a96-4177-8866-66131d77c39b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-03bedef0-76ae-4789-8713-f7ad48495788 req-38c46521-c343-47ca-8f75-e90f70f72b42 service nova] Lock "083108da-0a96-4177-8866-66131d77c39b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.compute.manager [req-03bedef0-76ae-4789-8713-f7ad48495788 req-38c46521-c343-47ca-8f75-e90f70f72b42 service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] No waiting events found dispatching network-vif-plugged-44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:18 user nova-compute[82196]: WARNING nova.compute.manager [req-03bedef0-76ae-4789-8713-f7ad48495788 req-38c46521-c343-47ca-8f75-e90f70f72b42 service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Received unexpected event network-vif-plugged-44671174-415b-41e7-964a-8c37ccb6a82d for instance with vm_state building and task_state spawning.
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 083108da-0a96-4177-8866-66131d77c39b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:18 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 083108da-0a96-4177-8866-66131d77c39b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241118.193807, 083108da-0a96-4177-8866-66131d77c39b => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:25:18 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 083108da-0a96-4177-8866-66131d77c39b] VM Started (Lifecycle Event)
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 083108da-0a96-4177-8866-66131d77c39b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 083108da-0a96-4177-8866-66131d77c39b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:25:18 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 083108da-0a96-4177-8866-66131d77c39b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:25:18 user nova-compute[82196]: INFO nova.compute.manager [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Took 7.74 seconds to spawn the instance on the hypervisor.
Apr 11 19:25:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:18 user nova-compute[82196]: INFO nova.compute.manager [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Took 8.61 seconds to build instance.
Apr 11 19:25:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54376e9c-41f4-477b-9b99-65535bdfc1ff tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "083108da-0a96-4177-8866-66131d77c39b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.713s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:19 user nova-compute[82196]: INFO nova.compute.manager [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Terminating instance
Apr 11 19:25:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:25:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:19 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Instance destroyed successfully.
Apr 11 19:25:19 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lazy-loading 'resources' on Instance uuid e84ad0e4-a65b-404c-adbf-c49d5f0b3cca {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-246020648',display_name='tempest-ServersNegativeTestJSON-server-246020648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-246020648',id=13,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:23:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d5d7769df1e4974b295cb30407151dd',ramdisk_id='',reservation_id='r-db76um4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1311045721',owner_user_name='tempest-ServersNegativeTestJSON-1311045721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:23:35Z,user_data=None,user_id='2f44dfa2528b4540a81f4eb7c3f3f2f5',uuid=e84ad0e4-a65b-404c-adbf-c49d5f0b3cca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27172120-33d2-4fbe-9af2-e8376499f9bc", "address": "fa:16:3e:40:73:39", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27172120-33", "ovs_interfaceid": "27172120-33d2-4fbe-9af2-e8376499f9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Converting VIF {"id": "27172120-33d2-4fbe-9af2-e8376499f9bc", "address": "fa:16:3e:40:73:39", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27172120-33", "ovs_interfaceid": "27172120-33d2-4fbe-9af2-e8376499f9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:73:39,bridge_name='br-int',has_traffic_filtering=True,id=27172120-33d2-4fbe-9af2-e8376499f9bc,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27172120-33') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG os_vif [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:73:39,bridge_name='br-int',has_traffic_filtering=True,id=27172120-33d2-4fbe-9af2-e8376499f9bc,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27172120-33') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27172120-33, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:25:20 user nova-compute[82196]: INFO os_vif [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:73:39,bridge_name='br-int',has_traffic_filtering=True,id=27172120-33d2-4fbe-9af2-e8376499f9bc,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27172120-33')
Apr 11 19:25:20 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Deleting instance files /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca_del
Apr 11 19:25:20 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Deletion of /opt/stack/data/nova/instances/e84ad0e4-a65b-404c-adbf-c49d5f0b3cca_del complete
Apr 11 19:25:20 user nova-compute[82196]: INFO nova.compute.manager [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 11 19:25:20 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Received event network-vif-unplugged-27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] Acquiring lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] No waiting events found dispatching network-vif-unplugged-27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Received event network-vif-unplugged-27172120-33d2-4fbe-9af2-e8376499f9bc for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Received event network-vif-plugged-27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] Acquiring lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] No waiting events found dispatching network-vif-plugged-27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:20 user nova-compute[82196]: WARNING nova.compute.manager [req-d33c83b8-b458-4ed4-8687-0a1c66a8597d req-f847289a-b747-4d07-afca-c36472d6596f service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Received unexpected event network-vif-plugged-27172120-33d2-4fbe-9af2-e8376499f9bc for instance with vm_state active and task_state deleting.
Apr 11 19:25:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "b71d95ed-728d-4386-b7c6-50b252718ca9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:20 user nova-compute[82196]: INFO nova.compute.manager [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Terminating instance
Apr 11 19:25:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:25:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:21 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:21 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Took 0.90 seconds to deallocate network for instance.
Apr 11 19:25:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:21 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:25:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:22 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Instance destroyed successfully.
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lazy-loading 'resources' on Instance uuid b71d95ed-728d-4386-b7c6-50b252718ca9 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T19:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1612946736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1612946736',id=8,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkMpWQuEm1Fv+W/mgY2OYSpggOfZUkoqqxBP4ppJK2h2yfEMM/I7umHLLvv+GHOLnvt+9wKNIfVoID5wNvYw3ZjffzrYq9zAWGLTOYlDtqreEy1EmtTM6C5cfTlcrcO1Q==',key_name='tempest-keypair-1575443570',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f39e7fdf571442b0a6f136020a99f7fb',ramdisk_id='',reservation_id='r-fla1mq5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1678913086',owner_user_name='tempest-TaggedAttachmentsTest-1678913086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f84e7cbdf6a4e588753fea907beba0c',uuid=b71d95ed-728d-4386-b7c6-50b252718ca9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converting VIF {"id": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "address": "fa:16:3e:85:20:b8", "network": {"id": "b8acbf9d-6e60-4540-9c11-751b6c4fac3a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-834654755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f39e7fdf571442b0a6f136020a99f7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd141d-04", "ovs_interfaceid": "64bd141d-04e6-46e6-bb46-e997d3234fa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:20:b8,bridge_name='br-int',has_traffic_filtering=True,id=64bd141d-04e6-46e6-bb46-e997d3234fa1,network=Network(b8acbf9d-6e60-4540-9c11-751b6c4fac3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd141d-04') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG os_vif [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:20:b8,bridge_name='br-int',has_traffic_filtering=True,id=64bd141d-04e6-46e6-bb46-e997d3234fa1,network=Network(b8acbf9d-6e60-4540-9c11-751b6c4fac3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd141d-04') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.995s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64bd141d-04, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:22 user nova-compute[82196]: INFO os_vif [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:20:b8,bridge_name='br-int',has_traffic_filtering=True,id=64bd141d-04e6-46e6-bb46-e997d3234fa1,network=Network(b8acbf9d-6e60-4540-9c11-751b6c4fac3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd141d-04')
Apr 11 19:25:22 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Deleting instance files /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9_del
Apr 11 19:25:22 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Deletion of /opt/stack/data/nova/instances/b71d95ed-728d-4386-b7c6-50b252718ca9_del complete
Apr 11 19:25:22 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Deleted allocations for instance e84ad0e4-a65b-404c-adbf-c49d5f0b3cca
Apr 11 19:25:22 user nova-compute[82196]: INFO nova.compute.manager [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Took 1.37 seconds to destroy the instance on the hypervisor.
Apr 11 19:25:22 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a949e73-29e2-492f-a8d0-e08120b8b016 tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "e84ad0e4-a65b-404c-adbf-c49d5f0b3cca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.260s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Received event network-vif-deleted-27172120-33d2-4fbe-9af2-e8376499f9bc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received event network-vif-unplugged-64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Acquiring lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] No waiting events found dispatching network-vif-unplugged-64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received event network-vif-unplugged-64bd141d-04e6-46e6-bb46-e997d3234fa1 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received event network-vif-plugged-64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Acquiring lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] No waiting events found dispatching network-vif-plugged-64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:22 user nova-compute[82196]: WARNING nova.compute.manager [req-60366133-05d3-4120-b5e2-74b557f5e0f2 req-cd82ddaf-17de-41c5-9915-2d61616c9e60 service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received unexpected event network-vif-plugged-64bd141d-04e6-46e6-bb46-e997d3234fa1 for instance with vm_state active and task_state deleting.
Apr 11 19:25:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:24 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:24 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Took 1.75 seconds to deallocate network for instance.
Apr 11 19:25:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-5c37b274-48af-4225-9d19-69a36eb6576d req-46905a7b-2903-4a16-957e-11bf7aa5326c service nova] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Received event network-vif-deleted-64bd141d-04e6-46e6-bb46-e997d3234fa1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:24 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:25:24 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:25:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:24 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Deleted allocations for instance b71d95ed-728d-4386-b7c6-50b252718ca9
Apr 11 19:25:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d86829e-c473-43d8-8509-72a692d42da7 tempest-TaggedAttachmentsTest-1678913086 tempest-TaggedAttachmentsTest-1678913086-project-member] Lock "b71d95ed-728d-4386-b7c6-50b252718ca9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.882s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:25:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:29 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:25:29 user nova-compute[82196]: INFO nova.compute.claims [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Claim successful on node user
Apr 11 19:25:29 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:25:29 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:25:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:25:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:25:29 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:25:29 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:25:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG nova.policy [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:25:30 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Creating image(s)
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "/opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "/opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.158s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk 1073741824" returned: 0 in 0.055s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Successfully created port: 8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Cannot resize image /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'migration_context' on Instance uuid 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Ensure instance console log exists: /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:31 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Successfully updated port: 8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:25:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:25:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquired lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:25:31 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:25:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Received event network-changed-8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Refreshing instance network info cache due to event network-changed-8c77eb6a-6186-4c87-9e30-48420d525f90. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:25:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] Acquiring lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:25:31 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:25:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Updating instance_info_cache with network_info: [{"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Releasing lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Instance network_info: |[{"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] Acquired lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.network.neutron [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Refreshing network info cache for port 8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Start _get_guest_xml network_info=[{"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:25:32 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:25:32 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:25:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-309051286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-309051286',id=18,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-0tio27u6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:25:30Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=9e2d23e8-2d2e-4b3e-94d8-01b17242dac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:4e:8b,bridge_name='br-int',has_traffic_filtering=True,id=8c77eb6a-6186-4c87-9e30-48420d525f90,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c77eb6a-61') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:25:32 user nova-compute[82196]:   <uuid>9e2d23e8-2d2e-4b3e-94d8-01b17242dac5</uuid>
Apr 11 19:25:32 user nova-compute[82196]:   <name>instance-00000012</name>
Apr 11 19:25:32 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:25:32 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:25:32 user nova-compute[82196]:   <metadata>
Apr 11 19:25:32 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:25:32 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:25:32 user nova-compute[82196]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-309051286</nova:name>
Apr 11 19:25:32 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:25:32</nova:creationTime>
Apr 11 19:25:32 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:25:32 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:25:32 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:25:32 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:25:32 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:25:32 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:25:32 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:25:32 user nova-compute[82196]:       <nova:owner>
Apr 11 19:25:32 user nova-compute[82196]:         <nova:user uuid="1b3adca432b04d70818a51d1366f5c6d">tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member</nova:user>
Apr 11 19:25:32 user nova-compute[82196]:         <nova:project uuid="eb91586feb3f4a4c84fa8c2183baaf8c">tempest-ServerBootFromVolumeStableRescueTest-863156619</nova:project>
Apr 11 19:25:32 user nova-compute[82196]:       </nova:owner>
Apr 11 19:25:32 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:25:32 user nova-compute[82196]:       <nova:ports>
Apr 11 19:25:32 user nova-compute[82196]:         <nova:port uuid="8c77eb6a-6186-4c87-9e30-48420d525f90">
Apr 11 19:25:32 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 19:25:32 user nova-compute[82196]:         </nova:port>
Apr 11 19:25:32 user nova-compute[82196]:       </nova:ports>
Apr 11 19:25:32 user nova-compute[82196]:     </nova:instance>
Apr 11 19:25:32 user nova-compute[82196]:   </metadata>
Apr 11 19:25:32 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:25:32 user nova-compute[82196]:     <system>
Apr 11 19:25:32 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:25:32 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:25:32 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:25:32 user nova-compute[82196]:       <entry name="serial">9e2d23e8-2d2e-4b3e-94d8-01b17242dac5</entry>
Apr 11 19:25:32 user nova-compute[82196]:       <entry name="uuid">9e2d23e8-2d2e-4b3e-94d8-01b17242dac5</entry>
Apr 11 19:25:32 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:25:32 user nova-compute[82196]:     </system>
Apr 11 19:25:32 user nova-compute[82196]:   </sysinfo>
Apr 11 19:25:32 user nova-compute[82196]:   <os>
Apr 11 19:25:32 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:25:32 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:25:32 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:25:32 user nova-compute[82196]:   </os>
Apr 11 19:25:32 user nova-compute[82196]:   <features>
Apr 11 19:25:32 user nova-compute[82196]:     <acpi/>
Apr 11 19:25:32 user nova-compute[82196]:     <apic/>
Apr 11 19:25:32 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:25:32 user nova-compute[82196]:   </features>
Apr 11 19:25:32 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:25:32 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:25:32 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:25:32 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:25:32 user nova-compute[82196]:   </clock>
Apr 11 19:25:32 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:25:32 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:25:32 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:25:32 user nova-compute[82196]:   </cpu>
Apr 11 19:25:32 user nova-compute[82196]:   <devices>
Apr 11 19:25:32 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:25:32 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:25:32 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk"/>
Apr 11 19:25:32 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:25:32 user nova-compute[82196]:     </disk>
Apr 11 19:25:32 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:25:32 user nova-compute[82196]:       <mac address="fa:16:3e:91:4e:8b"/>
Apr 11 19:25:32 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:25:32 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:25:32 user nova-compute[82196]:       <target dev="tap8c77eb6a-61"/>
Apr 11 19:25:32 user nova-compute[82196]:     </interface>
Apr 11 19:25:32 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:25:32 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/console.log" append="off"/>
Apr 11 19:25:32 user nova-compute[82196]:     </serial>
Apr 11 19:25:32 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:25:32 user nova-compute[82196]:     <video>
Apr 11 19:25:32 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:25:32 user nova-compute[82196]:     </video>
Apr 11 19:25:32 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:25:32 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:25:32 user nova-compute[82196]:     </rng>
Apr 11 19:25:32 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:25:32 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:25:32 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:25:32 user nova-compute[82196]:     </memballoon>
Apr 11 19:25:32 user nova-compute[82196]:   </devices>
Apr 11 19:25:32 user nova-compute[82196]: </domain>
Apr 11 19:25:32 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:25:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-309051286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-309051286',id=18,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-0tio27u6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:25:30Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=9e2d23e8-2d2e-4b3e-94d8-01b17242dac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:4e:8b,bridge_name='br-int',has_traffic_filtering=True,id=8c77eb6a-6186-4c87-9e30-48420d525f90,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c77eb6a-61') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG os_vif [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:4e:8b,bridge_name='br-int',has_traffic_filtering=True,id=8c77eb6a-6186-4c87-9e30-48420d525f90,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c77eb6a-61') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c77eb6a-61, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c77eb6a-61, col_values=(('external_ids', {'iface-id': '8c77eb6a-6186-4c87-9e30-48420d525f90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:4e:8b', 'vm-uuid': '9e2d23e8-2d2e-4b3e-94d8-01b17242dac5'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:32 user nova-compute[82196]: INFO os_vif [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:4e:8b,bridge_name='br-int',has_traffic_filtering=True,id=8c77eb6a-6186-4c87-9e30-48420d525f90,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c77eb6a-61')
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No VIF found with MAC fa:16:3e:91:4e:8b, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.network.neutron [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Updated VIF entry in instance network info cache for port 8c77eb6a-6186-4c87-9e30-48420d525f90. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG nova.network.neutron [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Updating instance_info_cache with network_info: [{"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-50706c73-cd2d-49d9-b4a1-4efdd3398096 req-20324a93-199c-4f4e-b90d-2743d927b5c2 service nova] Releasing lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:25:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:33 user nova-compute[82196]: DEBUG nova.compute.manager [req-20eb0cc2-ec97-46b0-a425-c2c3861cc379 req-f019c566-988c-4536-b4ec-8af626c4aefa service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Received event network-vif-plugged-8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-20eb0cc2-ec97-46b0-a425-c2c3861cc379 req-f019c566-988c-4536-b4ec-8af626c4aefa service nova] Acquiring lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-20eb0cc2-ec97-46b0-a425-c2c3861cc379 req-f019c566-988c-4536-b4ec-8af626c4aefa service nova] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-20eb0cc2-ec97-46b0-a425-c2c3861cc379 req-f019c566-988c-4536-b4ec-8af626c4aefa service nova] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:33 user nova-compute[82196]: DEBUG nova.compute.manager [req-20eb0cc2-ec97-46b0-a425-c2c3861cc379 req-f019c566-988c-4536-b4ec-8af626c4aefa service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] No waiting events found dispatching network-vif-plugged-8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:33 user nova-compute[82196]: WARNING nova.compute.manager [req-20eb0cc2-ec97-46b0-a425-c2c3861cc379 req-f019c566-988c-4536-b4ec-8af626c4aefa service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Received unexpected event network-vif-plugged-8c77eb6a-6186-4c87-9e30-48420d525f90 for instance with vm_state building and task_state spawning.
Apr 11 19:25:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:34 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241119.9728968, e84ad0e4-a65b-404c-adbf-c49d5f0b3cca => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:25:34 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] VM Stopped (Lifecycle Event)
Apr 11 19:25:34 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bb4a2023-b828-423c-aebe-e28b301d368d None None] [instance: e84ad0e4-a65b-404c-adbf-c49d5f0b3cca] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241135.8003733, 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:25:35 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] VM Resumed (Lifecycle Event)
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:25:35 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Instance spawned successfully.
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:25:35 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241135.8080018, 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:25:35 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] VM Started (Lifecycle Event)
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.compute.manager [req-2e55a8f1-3649-4b62-86f8-0db35198b780 req-636578d3-2d0d-48b5-9c69-291ef4c97b08 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Received event network-vif-plugged-8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2e55a8f1-3649-4b62-86f8-0db35198b780 req-636578d3-2d0d-48b5-9c69-291ef4c97b08 service nova] Acquiring lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2e55a8f1-3649-4b62-86f8-0db35198b780 req-636578d3-2d0d-48b5-9c69-291ef4c97b08 service nova] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2e55a8f1-3649-4b62-86f8-0db35198b780 req-636578d3-2d0d-48b5-9c69-291ef4c97b08 service nova] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.compute.manager [req-2e55a8f1-3649-4b62-86f8-0db35198b780 req-636578d3-2d0d-48b5-9c69-291ef4c97b08 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] No waiting events found dispatching network-vif-plugged-8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:35 user nova-compute[82196]: WARNING nova.compute.manager [req-2e55a8f1-3649-4b62-86f8-0db35198b780 req-636578d3-2d0d-48b5-9c69-291ef4c97b08 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Received unexpected event network-vif-plugged-8c77eb6a-6186-4c87-9e30-48420d525f90 for instance with vm_state building and task_state spawning.
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:25:35 user nova-compute[82196]: INFO nova.compute.manager [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Took 5.77 seconds to spawn the instance on the hypervisor.
Apr 11 19:25:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:35 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:25:36 user nova-compute[82196]: INFO nova.compute.manager [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Took 6.61 seconds to build instance.
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8e262b2f-f3cb-4e1b-ad2e-cf795f8603e6 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.745s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'flavor' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:36 user nova-compute[82196]: INFO nova.compute.manager [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Attaching volume f2d4810b-a6fe-4903-813a-a0562018f061 to /dev/vdb
Apr 11 19:25:36 user nova-compute[82196]: DEBUG os_brick.utils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdcb4de-c67d-49fa-8445-8fb600901a6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[effda227-b110-4ae6-a944-536204c8be14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f66d856-ddaf-4103-89f6-37754bfc4538]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3a34c1-60bf-4eb1-a5c4-3802dbb70183]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:25:36 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da19223-d298-44ae-9720-734159cba94e]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG os_brick.utils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updating existing volume attachment record: f39e3def-1175-44ee-9ff0-fc32fb545eeb {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a49d379e-3976-4d68-b6df-f572a922107c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a49d379e-3976-4d68-b6df-f572a922107c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "a49d379e-3976-4d68-b6df-f572a922107c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a49d379e-3976-4d68-b6df-f572a922107c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a49d379e-3976-4d68-b6df-f572a922107c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:36 user nova-compute[82196]: INFO nova.compute.manager [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Terminating instance
Apr 11 19:25:36 user nova-compute[82196]: DEBUG nova.compute.manager [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241122.0510886, b71d95ed-728d-4386-b7c6-50b252718ca9 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:25:37 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] VM Stopped (Lifecycle Event)
Apr 11 19:25:37 user nova-compute[82196]: DEBUG nova.compute.manager [None req-77ad2b75-67e2-44fc-8ddd-0e9bc1502a4f None None] [instance: b71d95ed-728d-4386-b7c6-50b252718ca9] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG nova.compute.manager [req-5d63a407-d552-4410-b6c4-f009f6d0086b req-861dc99e-c90a-48e8-8274-d626d030acd0 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Received event network-vif-unplugged-936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5d63a407-d552-4410-b6c4-f009f6d0086b req-861dc99e-c90a-48e8-8274-d626d030acd0 service nova] Acquiring lock "a49d379e-3976-4d68-b6df-f572a922107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5d63a407-d552-4410-b6c4-f009f6d0086b req-861dc99e-c90a-48e8-8274-d626d030acd0 service nova] Lock "a49d379e-3976-4d68-b6df-f572a922107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5d63a407-d552-4410-b6c4-f009f6d0086b req-861dc99e-c90a-48e8-8274-d626d030acd0 service nova] Lock "a49d379e-3976-4d68-b6df-f572a922107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG nova.compute.manager [req-5d63a407-d552-4410-b6c4-f009f6d0086b req-861dc99e-c90a-48e8-8274-d626d030acd0 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] No waiting events found dispatching network-vif-unplugged-936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG nova.compute.manager [req-5d63a407-d552-4410-b6c4-f009f6d0086b req-861dc99e-c90a-48e8-8274-d626d030acd0 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Received event network-vif-unplugged-936e8263-dbb3-4e76-8f6d-0e3269dc6066 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:25:37 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Instance destroyed successfully.
Apr 11 19:25:37 user nova-compute[82196]: DEBUG nova.objects.instance [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lazy-loading 'resources' on Instance uuid a49d379e-3976-4d68-b6df-f572a922107c {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1592033128',display_name='tempest-TestVolumeSwap-server-1592033128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1592033128',id=6,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAzMdMSQLLiV3JpjVwmLTTmwbzkoJeV6SA3UR8oDreyp/7jf42SjayBVPZUVEXJCuPvBauTtzXHflWxGcTjSNelxaY2xGUn/tnq1c/9lLP/bJj0WIjeFFfa+9CmZIz9FA==',key_name='tempest-keypair-1479395347',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9f8ee2edca748e0bd03ace6f93be649',ramdisk_id='',reservation_id='r-udaehb89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1558953300',owner_user_name='tempest-TestVolumeSwap-1558953300-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24e95f55f8f9497592320a19f2ca7fb8',uuid=a49d379e-3976-4d68-b6df-f572a922107c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "address": "fa:16:3e:bf:52:8c", "network": {"id": "f46874c2-3c80-4650-be3d-22d674b93195", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1165457224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f8ee2edca748e0bd03ace6f93be649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap936e8263-db", "ovs_interfaceid": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Converting VIF {"id": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "address": "fa:16:3e:bf:52:8c", "network": {"id": "f46874c2-3c80-4650-be3d-22d674b93195", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1165457224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f8ee2edca748e0bd03ace6f93be649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap936e8263-db", "ovs_interfaceid": "936e8263-dbb3-4e76-8f6d-0e3269dc6066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=936e8263-dbb3-4e76-8f6d-0e3269dc6066,network=Network(f46874c2-3c80-4650-be3d-22d674b93195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap936e8263-db') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG os_vif [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=936e8263-dbb3-4e76-8f6d-0e3269dc6066,network=Network(f46874c2-3c80-4650-be3d-22d674b93195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap936e8263-db') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap936e8263-db, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:25:37 user nova-compute[82196]: INFO os_vif [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:52:8c,bridge_name='br-int',has_traffic_filtering=True,id=936e8263-dbb3-4e76-8f6d-0e3269dc6066,network=Network(f46874c2-3c80-4650-be3d-22d674b93195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap936e8263-db')
Apr 11 19:25:37 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Deleting instance files /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c_del
Apr 11 19:25:37 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Deletion of /opt/stack/data/nova/instances/a49d379e-3976-4d68-b6df-f572a922107c_del complete
Apr 11 19:25:37 user nova-compute[82196]: INFO nova.compute.manager [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 11 19:25:37 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:25:37 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: a49d379e-3976-4d68-b6df-f572a922107c] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:25:38 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:38 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Took 0.77 seconds to deallocate network for instance.
Apr 11 19:25:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-d78386b2-2e69-4754-a85e-9573884183c3 req-8094c5bc-e39b-4dca-a4ec-995961d37963 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Received event network-vif-deleted-936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:38 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:25:38 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:25:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:39 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Deleted allocations for instance a49d379e-3976-4d68-b6df-f572a922107c
Apr 11 19:25:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-66ba5d29-ef1c-490d-b2ae-f2ad518ae56c tempest-TestVolumeSwap-1558953300 tempest-TestVolumeSwap-1558953300-project-member] Lock "a49d379e-3976-4d68-b6df-f572a922107c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.322s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:39 user nova-compute[82196]: DEBUG nova.compute.manager [req-1b867779-6a13-4d12-9ccb-36ffde6e097b req-020ca99a-bfad-4362-be7a-199da2af7346 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Received event network-vif-plugged-936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1b867779-6a13-4d12-9ccb-36ffde6e097b req-020ca99a-bfad-4362-be7a-199da2af7346 service nova] Acquiring lock "a49d379e-3976-4d68-b6df-f572a922107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1b867779-6a13-4d12-9ccb-36ffde6e097b req-020ca99a-bfad-4362-be7a-199da2af7346 service nova] Lock "a49d379e-3976-4d68-b6df-f572a922107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1b867779-6a13-4d12-9ccb-36ffde6e097b req-020ca99a-bfad-4362-be7a-199da2af7346 service nova] Lock "a49d379e-3976-4d68-b6df-f572a922107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:39 user nova-compute[82196]: DEBUG nova.compute.manager [req-1b867779-6a13-4d12-9ccb-36ffde6e097b req-020ca99a-bfad-4362-be7a-199da2af7346 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] No waiting events found dispatching network-vif-plugged-936e8263-dbb3-4e76-8f6d-0e3269dc6066 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:39 user nova-compute[82196]: WARNING nova.compute.manager [req-1b867779-6a13-4d12-9ccb-36ffde6e097b req-020ca99a-bfad-4362-be7a-199da2af7346 service nova] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Received unexpected event network-vif-plugged-936e8263-dbb3-4e76-8f6d-0e3269dc6066 for instance with vm_state deleted and task_state None.
Apr 11 19:25:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:25:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:25:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:25:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:25:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:25:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:25:40 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:25:40 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updating instance_info_cache with network_info: [{"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTNDBvjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:25:41 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:25:41 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:25:41 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e104e52b-73cf-466f-984f-ee2f8de423f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:25:41 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Received event network-changed-dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Refreshing instance network info cache due to event network-changed-dfba7f5a-ea64-4504-8547-47f354d6a6ef. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] Acquiring lock "refresh_cache-53ccc829-6323-48ec-b63f-9de9bc607456" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] Acquired lock "refresh_cache-53ccc829-6323-48ec-b63f-9de9bc607456" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG nova.network.neutron [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Refreshing network info cache for port dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[237955ce-4b7a-4d6e-ad8a-eb298314d2ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061] added
Apr 11 19:25:41 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e529ccb7-7995-4416-b714-293f83ecbf37]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbf38dd-79d0-4a19-8d7f-9756f6abe9c1]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTNDBvjO {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTNDBvjO" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f347dd16-283b-4f69-ac35-b8c6580a1285]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MTNDBvjO'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d306baf5-314b-4a20-be9e-57246a45a5d5]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a68558-fa87-4709-82b4-6f969a93cdac]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:25:41 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:25:41 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[64374e7f-b688-4ab4-8111-605025b9782a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061, portal: 172.16.0.220,3260]
Apr 11 19:25:41 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061, portal: 172.16.0.220,3260] successful.
Apr 11 19:25:41 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[930092f2-7599-4f43-84f9-fb3b5bbe68a6]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3921d3-28d7-495a-b1aa-234d3272b9ff]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:25:41 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:25:41 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:25:41 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:25:41 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.470s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e1d747-feb9-46f2-be65-17289cfa5a3a]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTNDBvjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "53ccc829-6323-48ec-b63f-9de9bc607456" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "53ccc829-6323-48ec-b63f-9de9bc607456" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:41 user nova-compute[82196]: INFO nova.compute.manager [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Terminating instance
Apr 11 19:25:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG nova.network.neutron [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Updated VIF entry in instance network info cache for port dfba7f5a-ea64-4504-8547-47f354d6a6ef. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG nova.network.neutron [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Updating instance_info_cache with network_info: [{"id": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "address": "fa:16:3e:91:89:c6", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfba7f5a-ea", "ovs_interfaceid": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2f42dd2f-d81e-43ad-a7ad-7013fa173fa8 req-f421096e-0bf0-4610-a36d-c7ba61f2b1b2 service nova] Releasing lock "refresh_cache-53ccc829-6323-48ec-b63f-9de9bc607456" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:42 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Instance destroyed successfully.
Apr 11 19:25:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'resources' on Instance uuid 53ccc829-6323-48ec-b63f-9de9bc607456 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:23:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-953463719',display_name='tempest-AttachVolumeNegativeTest-server-953463719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-953463719',id=14,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMHXuZwHHLTnbwoXHlgW9zf8bL7zVpVkgemb7OvTI/oU7VrYb4dENt1Gx29wnClpENAL4bXzn2wWqsFi41+TNpH3ExAk1aECdr1t7t6sLObcWObhGaOVQ3v0wbmGz14ZA==',key_name='tempest-keypair-985453267',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:23:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06966e2f4d3a4dec92282c7ad348635d',ramdisk_id='',reservation_id='r-ni3ktelu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-303418642',owner_user_name='tempest-AttachVolumeNegativeTest-303418642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:23:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d405421ceb4d99967ef2e7f55e7809',uuid=53ccc829-6323-48ec-b63f-9de9bc607456,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "address": "fa:16:3e:91:89:c6", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfba7f5a-ea", "ovs_interfaceid": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converting VIF {"id": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "address": "fa:16:3e:91:89:c6", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfba7f5a-ea", "ovs_interfaceid": "dfba7f5a-ea64-4504-8547-47f354d6a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfba7f5a-ea64-4504-8547-47f354d6a6ef,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfba7f5a-ea') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG os_vif [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfba7f5a-ea64-4504-8547-47f354d6a6ef,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfba7f5a-ea') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfba7f5a-ea, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:25:42 user nova-compute[82196]: INFO os_vif [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfba7f5a-ea64-4504-8547-47f354d6a6ef,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfba7f5a-ea')
Apr 11 19:25:42 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Deleting instance files /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456_del
Apr 11 19:25:42 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Deletion of /opt/stack/data/nova/instances/53ccc829-6323-48ec-b63f-9de9bc607456_del complete
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:42 user nova-compute[82196]: INFO nova.compute.manager [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Took 0.81 seconds to destroy the instance on the hypervisor.
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.525s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] <== connect_volume: return (1529ms) {'type': 'block', 'scsi_wwn': '23132303338643732', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132303338643732', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'flavor' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:25:42 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:25:42 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:25:42 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:25:42 user nova-compute[82196]:   <serial>f2d4810b-a6fe-4903-813a-a0562018f061</serial>
Apr 11 19:25:42 user nova-compute[82196]: </disk>
Apr 11 19:25:42 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:25:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] No VIF found with MAC fa:16:3e:eb:eb:fe, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Received event network-vif-unplugged-dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] Acquiring lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] Lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] Lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] No waiting events found dispatching network-vif-unplugged-dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Received event network-vif-unplugged-dfba7f5a-ea64-4504-8547-47f354d6a6ef for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Received event network-vif-plugged-dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] Acquiring lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] Lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] Lock "53ccc829-6323-48ec-b63f-9de9bc607456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] No waiting events found dispatching network-vif-plugged-dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:43 user nova-compute[82196]: WARNING nova.compute.manager [req-14cc3d42-80dd-4c43-aee6-30024078fd98 req-ab4c4a03-5508-4317-9a77-d10871ba570a service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Received unexpected event network-vif-plugged-dfba7f5a-ea64-4504-8547-47f354d6a6ef for instance with vm_state active and task_state deleting.
Apr 11 19:25:43 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:43 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Took 0.88 seconds to deallocate network for instance.
Apr 11 19:25:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-252f2cbe-79dd-4489-a796-d4e221b7c68f req-d8fead73-bc17-4f90-bad9-a6edb894802c service nova] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Received event network-vif-deleted-dfba7f5a-ea64-4504-8547-47f354d6a6ef {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a709ec49-7e2c-41da-a3f1-a45c9733d8d0 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.278s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:43 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Error from libvirt while getting description of instance-0000000e: [Error Code 42] Domain not found: no domain with matching uuid '53ccc829-6323-48ec-b63f-9de9bc607456' (instance-0000000e): libvirt.libvirtError: Domain not found: no domain with matching uuid '53ccc829-6323-48ec-b63f-9de9bc607456' (instance-0000000e)
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.556s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:44 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Deleted allocations for instance 53ccc829-6323-48ec-b63f-9de9bc607456
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d0002c6-e57e-442d-826c-63473c616659 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "53ccc829-6323-48ec-b63f-9de9bc607456" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.488s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:44 user nova-compute[82196]: INFO nova.compute.manager [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Rescuing
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquired lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:44 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:45 user nova-compute[82196]: INFO nova.compute.manager [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] instance snapshotting
Apr 11 19:25:45 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:25:45 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7378MB free_disk=26.54962158203125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:45 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Beginning live snapshot process
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bed4001c-02c2-4c6b-84c8-61654df66d8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9941d033-15c2-4069-b9a6-f80840e95a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6802f099-9236-4c79-a892-2963f1b15b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance ac961841-1fc4-4cec-89bd-8f932270441a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 083108da-0a96-4177-8866-66131d77c39b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json -f qcow2 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updating instance_info_cache with network_info: [{"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Releasing lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json -f qcow2 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json -f qcow2" returned: 0 in 0.166s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:25:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.719s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.218s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl6uj8tcl/df805640cc2d48bb939b819386d3bae7.delta 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-79d5a192-a6df-4da5-b9b6-4ea8658e3560 req-49639e55-e237-4f8a-8cc1-945e18e11d87 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-unplugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-79d5a192-a6df-4da5-b9b6-4ea8658e3560 req-49639e55-e237-4f8a-8cc1-945e18e11d87 service nova] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-79d5a192-a6df-4da5-b9b6-4ea8658e3560 req-49639e55-e237-4f8a-8cc1-945e18e11d87 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-79d5a192-a6df-4da5-b9b6-4ea8658e3560 req-49639e55-e237-4f8a-8cc1-945e18e11d87 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-79d5a192-a6df-4da5-b9b6-4ea8658e3560 req-49639e55-e237-4f8a-8cc1-945e18e11d87 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] No waiting events found dispatching network-vif-unplugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:46 user nova-compute[82196]: WARNING nova.compute.manager [req-79d5a192-a6df-4da5-b9b6-4ea8658e3560 req-49639e55-e237-4f8a-8cc1-945e18e11d87 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received unexpected event network-vif-unplugged-5a15e207-1839-4be5-80b2-fc995098dbbf for instance with vm_state active and task_state rescuing.
Apr 11 19:25:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl6uj8tcl/df805640cc2d48bb939b819386d3bae7.delta 1073741824" returned: 0 in 0.060s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:46 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 19:25:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:25:47 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Instance destroyed successfully.
Apr 11 19:25:47 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Attempting a stable device rescue
Apr 11 19:25:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=82196) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 19:25:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Instance directory exists: not creating {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 19:25:47 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Creating image(s)
Apr 11 19:25:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "/opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "/opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:47 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'trusted_certs' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "cedaaac894b2c27ba5e83cd337150871a7ec191b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "cedaaac894b2c27ba5e83cd337150871a7ec191b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b.part --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG nova.compute.manager [req-55bd52ad-ef98-47df-836c-342456f7e17c req-dd012ceb-20d3-4c5b-a64e-9030203b0ff0 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-55bd52ad-ef98-47df-836c-342456f7e17c req-dd012ceb-20d3-4c5b-a64e-9030203b0ff0 service nova] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-55bd52ad-ef98-47df-836c-342456f7e17c req-dd012ceb-20d3-4c5b-a64e-9030203b0ff0 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-55bd52ad-ef98-47df-836c-342456f7e17c req-dd012ceb-20d3-4c5b-a64e-9030203b0ff0 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG nova.compute.manager [req-55bd52ad-ef98-47df-836c-342456f7e17c req-dd012ceb-20d3-4c5b-a64e-9030203b0ff0 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] No waiting events found dispatching network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:49 user nova-compute[82196]: WARNING nova.compute.manager [req-55bd52ad-ef98-47df-836c-342456f7e17c req-dd012ceb-20d3-4c5b-a64e-9030203b0ff0 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received unexpected event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf for instance with vm_state active and task_state rescuing.
Apr 11 19:25:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:25:49 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b.part --force-share --output=json" returned: 0 in 0.236s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG nova.virt.images [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] 6a269858-cd4f-452f-ae3e-e35cf198749c was qcow2, converting to raw {{(pid=82196) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b.part /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b.converted {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl6uj8tcl/df805640cc2d48bb939b819386d3bae7.delta /opt/stack/data/nova/instances/snapshots/tmpl6uj8tcl/df805640cc2d48bb939b819386d3bae7 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b.part /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b.converted" returned: 0 in 0.375s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b.converted --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "cedaaac894b2c27ba5e83cd337150871a7ec191b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.350s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "cedaaac894b2c27ba5e83cd337150871a7ec191b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "cedaaac894b2c27ba5e83cd337150871a7ec191b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl6uj8tcl/df805640cc2d48bb939b819386d3bae7.delta /opt/stack/data/nova/instances/snapshots/tmpl6uj8tcl/df805640cc2d48bb939b819386d3bae7" returned: 0 in 0.488s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:49 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Snapshot extracted, beginning image upload
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b,backing_fmt=raw /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.rescue {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b,backing_fmt=raw /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.rescue" returned: 0 in 0.079s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "cedaaac894b2c27ba5e83cd337150871a7ec191b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'migration_context' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Start _get_guest_xml network_info=[{"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "vif_mac": "fa:16:3e:eb:eb:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6a269858-cd4f-452f-ae3e-e35cf198749c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTNDBvjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'aa0bb9aa-a93d-45bc-9f90-46eeb6416365', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2d4810b-a6fe-4903-813a-a0562018f061', 'serial': 'f2d4810b-a6fe-4903-813a-a0562018f061'}, 'attachment_id': 'f39e3def-1175-44ee-9ff0-fc32fb545eeb', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'resources' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:49 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'numa_topology' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:49 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:25:49 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTNDBvjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:25:50 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:25:50 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:25:50 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[696c4606-bdae-4c43-ac0c-b22db7015bdc]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = MTNDBvjO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 19:25:50 user nova-compute[82196]: node.name = iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061
Apr 11 19:25:50 user nova-compute[82196]: node.tpgt = -1
Apr 11 19:25:50 user nova-compute[82196]: node.startup = automatic
Apr 11 19:25:50 user nova-compute[82196]: node.leading_login = No
Apr 11 19:25:50 user nova-compute[82196]: iface.iscsi_ifacename = default
Apr 11 19:25:50 user nova-compute[82196]: iface.net_ifacename = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.ipaddress = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.prefix_len = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.hwaddress = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.transport_name = tcp
Apr 11 19:25:50 user nova-compute[82196]: iface.initiatorname = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.state = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.vlan_id = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.vlan_priority = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.vlan_state = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.iface_num = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.mtu = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.port = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.bootproto = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.subnet_mask = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.gateway = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.dhcp_alt_client_id = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.dhcp_dns = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.dhcp_learn_iqn = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.dhcp_vendor_id_state = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.dhcp_vendor_id = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.dhcp_slp_da = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.fragmentation = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.gratuitous_arp = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.incoming_forwarding = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.tos_state = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.tos = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.ttl = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.delayed_ack = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.tcp_nagle = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.tcp_wsf_state = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.tcp_wsf = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.tcp_timer_scale = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.tcp_timestamp = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.redirect = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.def_task_mgmt_timeout = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.header_digest = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.data_digest = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.immediate_data = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.initial_r2t = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.data_seq_inorder = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.data_pdu_inorder = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.erl = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.max_receive_data_len = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.first_burst_len = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.max_outstanding_r2t = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.max_burst_len = 0
Apr 11 19:25:50 user nova-compute[82196]: iface.chap_auth = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.bidi_chap = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.strict_login_compliance = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.discovery_auth = <empty>
Apr 11 19:25:50 user nova-compute[82196]: iface.discovery_logout = <empty>
Apr 11 19:25:50 user nova-compute[82196]: node.discovery_address = <empty>
Apr 11 19:25:50 user nova-compute[82196]: node.discovery_port = 0
Apr 11 19:25:50 user nova-compute[82196]: node.discovery_type = static
Apr 11 19:25:50 user nova-compute[82196]: node.session.initial_cmdsn = 0
Apr 11 19:25:50 user nova-compute[82196]: node.session.initial_login_retry_max = 8
Apr 11 19:25:50 user nova-compute[82196]: node.session.xmit_thread_priority = -20
Apr 11 19:25:50 user nova-compute[82196]: node.session.cmds_max = 128
Apr 11 19:25:50 user nova-compute[82196]: node.session.queue_depth = 32
Apr 11 19:25:50 user nova-compute[82196]: node.session.nr_sessions = 1
Apr 11 19:25:50 user nova-compute[82196]: node.session.auth.authmethod = CHAP
Apr 11 19:25:50 user nova-compute[82196]: node.session.auth.username = MTNDBvjO
Apr 11 19:25:50 user nova-compute[82196]: node.session.auth.password = ***
Apr 11 19:25:50 user nova-compute[82196]: node.session.auth.username_in = <empty>
Apr 11 19:25:50 user nova-compute[82196]: node.session.auth.password_in = <empty>
Apr 11 19:25:50 user nova-compute[82196]: node.session.auth.chap_algs = MD5
Apr 11 19:25:50 user nova-compute[82196]: node.session.timeo.replacement_timeout = 120
Apr 11 19:25:50 user nova-compute[82196]: node.session.err_timeo.abort_timeout = 15
Apr 11 19:25:50 user nova-compute[82196]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 19:25:50 user nova-compute[82196]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 19:25:50 user nova-compute[82196]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 19:25:50 user nova-compute[82196]: node.session.iscsi.FastAbort = Yes
Apr 11 19:25:50 user nova-compute[82196]: node.session.iscsi.InitialR2T = No
Apr 11 19:25:50 user nova-compute[82196]: node.session.iscsi.ImmediateData = Yes
Apr 11 19:25:50 user nova-compute[82196]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 19:25:50 user nova-compute[82196]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 19:25:50 user nova-compute[82196]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 19:25:50 user nova-compute[82196]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 19:25:50 user nova-compute[82196]: node.session.iscsi.MaxConnections = 1
Apr 11 19:25:50 user nova-compute[82196]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 19:25:50 user nova-compute[82196]: node.session.iscsi.ERL = 0
Apr 11 19:25:50 user nova-compute[82196]: node.session.scan = manual
Apr 11 19:25:50 user nova-compute[82196]: node.session.reopen_max = 0
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].address = 172.16.0.220
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].port = 3260
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].startup = manual
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].tcp.window_size = 524288
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].tcp.type_of_service = 0
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].timeo.logout_timeout = 15
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].timeo.login_timeout = 15
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].timeo.auth_timeout = 45
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].iscsi.DataDigest = None
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].iscsi.IFMarker = No
Apr 11 19:25:50 user nova-compute[82196]: node.conn[0].iscsi.OFMarker = No
Apr 11 19:25:50 user nova-compute[82196]: # END RECORD
Apr 11 19:25:50 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac69d246-cf95-4c9b-9316-1fd92dc48906]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cd3bc7-13bf-496f-afe5-33193adedf9e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTNDBvjO {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTNDBvjO" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[99847fa7-358e-4c12-88ab-4d8702b71d80]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MTNDBvjO'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5efb79-5103-41bc-b008-7557cb1c3375]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4496b0-f297-4655-9639-13468ef1dc47]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:25:50 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:25:50 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:25:50 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:25:50 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] HCTL ('33', '0', '0', 0) found on session 17 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6717efa-fd4e-4ff9-9a7d-b449b5a48de0]: (4, ('0 0 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Searching for a device in session 17 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTNDBvjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '23132303338643732', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132303338643732', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-309951304',display_name='tempest-ServerStableDeviceRescueTest-server-309951304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-309951304',id=4,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQPHRAJfFRFeAUt5MqGdWAF2Vw2uFd+0nfpM413xhOuBbSDaV6LfVNTeVPCQwsh3pP3/wPGteAXUcszYrP1qam1IH+EIRD9QQUduJX8PlHQPLpnCt50NfjnO6EpONvQTg==',key_name='tempest-keypair-909036118',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11ee7c68b277420ba524c2a99cd444ea',ramdisk_id='',reservation_id='r-hjoe23y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-400855764',owner_user_name='tempest-ServerStableDeviceRescueTest-400855764-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:23:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26f091a1508b4d2689005b660f6a1380',uuid=aa0bb9aa-a93d-45bc-9f90-46eeb6416365,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "vif_mac": "fa:16:3e:eb:eb:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Converting VIF {"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "vif_mac": "fa:16:3e:eb:eb:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:eb:fe,bridge_name='br-int',has_traffic_filtering=True,id=5a15e207-1839-4be5-80b2-fc995098dbbf,network=Network(e637d15d-90c0-48cc-8229-ffd26c0be8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a15e207-18') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'pci_devices' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:25:50 user nova-compute[82196]:   <uuid>aa0bb9aa-a93d-45bc-9f90-46eeb6416365</uuid>
Apr 11 19:25:50 user nova-compute[82196]:   <name>instance-00000004</name>
Apr 11 19:25:50 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:25:50 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:25:50 user nova-compute[82196]:   <metadata>
Apr 11 19:25:50 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:25:50 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:25:50 user nova-compute[82196]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-309951304</nova:name>
Apr 11 19:25:50 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:25:50</nova:creationTime>
Apr 11 19:25:50 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:25:50 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:25:50 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:25:50 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:25:50 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:25:50 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:25:50 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:25:50 user nova-compute[82196]:       <nova:owner>
Apr 11 19:25:50 user nova-compute[82196]:         <nova:user uuid="26f091a1508b4d2689005b660f6a1380">tempest-ServerStableDeviceRescueTest-400855764-project-member</nova:user>
Apr 11 19:25:50 user nova-compute[82196]:         <nova:project uuid="11ee7c68b277420ba524c2a99cd444ea">tempest-ServerStableDeviceRescueTest-400855764</nova:project>
Apr 11 19:25:50 user nova-compute[82196]:       </nova:owner>
Apr 11 19:25:50 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:25:50 user nova-compute[82196]:       <nova:ports>
Apr 11 19:25:50 user nova-compute[82196]:         <nova:port uuid="5a15e207-1839-4be5-80b2-fc995098dbbf">
Apr 11 19:25:50 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 19:25:50 user nova-compute[82196]:         </nova:port>
Apr 11 19:25:50 user nova-compute[82196]:       </nova:ports>
Apr 11 19:25:50 user nova-compute[82196]:     </nova:instance>
Apr 11 19:25:50 user nova-compute[82196]:   </metadata>
Apr 11 19:25:50 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:25:50 user nova-compute[82196]:     <system>
Apr 11 19:25:50 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:25:50 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:25:50 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:25:50 user nova-compute[82196]:       <entry name="serial">aa0bb9aa-a93d-45bc-9f90-46eeb6416365</entry>
Apr 11 19:25:50 user nova-compute[82196]:       <entry name="uuid">aa0bb9aa-a93d-45bc-9f90-46eeb6416365</entry>
Apr 11 19:25:50 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:25:50 user nova-compute[82196]:     </system>
Apr 11 19:25:50 user nova-compute[82196]:   </sysinfo>
Apr 11 19:25:50 user nova-compute[82196]:   <os>
Apr 11 19:25:50 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:25:50 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:25:50 user nova-compute[82196]:   </os>
Apr 11 19:25:50 user nova-compute[82196]:   <features>
Apr 11 19:25:50 user nova-compute[82196]:     <acpi/>
Apr 11 19:25:50 user nova-compute[82196]:     <apic/>
Apr 11 19:25:50 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:25:50 user nova-compute[82196]:   </features>
Apr 11 19:25:50 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:25:50 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:25:50 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:25:50 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:25:50 user nova-compute[82196]:   </clock>
Apr 11 19:25:50 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:25:50 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:25:50 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:25:50 user nova-compute[82196]:   </cpu>
Apr 11 19:25:50 user nova-compute[82196]:   <devices>
Apr 11 19:25:50 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:25:50 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:25:50 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk"/>
Apr 11 19:25:50 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:25:50 user nova-compute[82196]:     </disk>
Apr 11 19:25:50 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:25:50 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:25:50 user nova-compute[82196]:       <source dev="/dev/sdb"/>
Apr 11 19:25:50 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:25:50 user nova-compute[82196]:       <serial>f2d4810b-a6fe-4903-813a-a0562018f061</serial>
Apr 11 19:25:50 user nova-compute[82196]:     </disk>
Apr 11 19:25:50 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:25:50 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:25:50 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.rescue"/>
Apr 11 19:25:50 user nova-compute[82196]:       <target dev="vdc" bus="virtio"/>
Apr 11 19:25:50 user nova-compute[82196]:       <boot order="1"/>
Apr 11 19:25:50 user nova-compute[82196]:     </disk>
Apr 11 19:25:50 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:25:50 user nova-compute[82196]:       <mac address="fa:16:3e:eb:eb:fe"/>
Apr 11 19:25:50 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:25:50 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:25:50 user nova-compute[82196]:       <target dev="tap5a15e207-18"/>
Apr 11 19:25:50 user nova-compute[82196]:     </interface>
Apr 11 19:25:50 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:25:50 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/console.log" append="off"/>
Apr 11 19:25:50 user nova-compute[82196]:     </serial>
Apr 11 19:25:50 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:25:50 user nova-compute[82196]:     <video>
Apr 11 19:25:50 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:25:50 user nova-compute[82196]:     </video>
Apr 11 19:25:50 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:25:50 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:25:50 user nova-compute[82196]:     </rng>
Apr 11 19:25:50 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:25:50 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:25:50 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:25:50 user nova-compute[82196]:     </memballoon>
Apr 11 19:25:50 user nova-compute[82196]:   </devices>
Apr 11 19:25:50 user nova-compute[82196]: </domain>
Apr 11 19:25:50 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:25:50 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Instance destroyed successfully.
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:25:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] No VIF found with MAC fa:16:3e:eb:eb:fe, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:25:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-eaebbff3-16e8-4d3b-85d6-667ce17bd280 req-7c10bf5a-cfa3-42b0-b0e6-252034436211 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-eaebbff3-16e8-4d3b-85d6-667ce17bd280 req-7c10bf5a-cfa3-42b0-b0e6-252034436211 service nova] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-eaebbff3-16e8-4d3b-85d6-667ce17bd280 req-7c10bf5a-cfa3-42b0-b0e6-252034436211 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-eaebbff3-16e8-4d3b-85d6-667ce17bd280 req-7c10bf5a-cfa3-42b0-b0e6-252034436211 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-eaebbff3-16e8-4d3b-85d6-667ce17bd280 req-7c10bf5a-cfa3-42b0-b0e6-252034436211 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] No waiting events found dispatching network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:52 user nova-compute[82196]: WARNING nova.compute.manager [req-eaebbff3-16e8-4d3b-85d6-667ce17bd280 req-7c10bf5a-cfa3-42b0-b0e6-252034436211 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received unexpected event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf for instance with vm_state active and task_state rescuing.
Apr 11 19:25:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Snapshot image upload complete
Apr 11 19:25:52 user nova-compute[82196]: INFO nova.compute.manager [None req-f0a898cc-2276-4347-95c5-a9d7a59e0350 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Took 7.09 seconds to snapshot the instance on the hypervisor.
Apr 11 19:25:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:52 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241137.5797184, a49d379e-3976-4d68-b6df-f572a922107c => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:25:52 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: a49d379e-3976-4d68-b6df-f572a922107c] VM Stopped (Lifecycle Event)
Apr 11 19:25:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7a157086-a70f-41f9-89f1-0d0914157583 None None] [instance: a49d379e-3976-4d68-b6df-f572a922107c] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-a19f2dd6-1820-4927-9ff0-9cac591b79d2 req-0308c9fa-b112-4d62-9538-b514d1a3c00b service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a19f2dd6-1820-4927-9ff0-9cac591b79d2 req-0308c9fa-b112-4d62-9538-b514d1a3c00b service nova] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a19f2dd6-1820-4927-9ff0-9cac591b79d2 req-0308c9fa-b112-4d62-9538-b514d1a3c00b service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a19f2dd6-1820-4927-9ff0-9cac591b79d2 req-0308c9fa-b112-4d62-9538-b514d1a3c00b service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-a19f2dd6-1820-4927-9ff0-9cac591b79d2 req-0308c9fa-b112-4d62-9538-b514d1a3c00b service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] No waiting events found dispatching network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:25:54 user nova-compute[82196]: WARNING nova.compute.manager [req-a19f2dd6-1820-4927-9ff0-9cac591b79d2 req-0308c9fa-b112-4d62-9538-b514d1a3c00b service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received unexpected event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf for instance with vm_state active and task_state rescuing.
Apr 11 19:25:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for aa0bb9aa-a93d-45bc-9f90-46eeb6416365 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:25:54 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241154.3532636, aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:25:54 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] VM Resumed (Lifecycle Event)
Apr 11 19:25:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6e06bae6-5ad5-44f7-888b-5ae0b27fe21c tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:25:54 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 19:25:54 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241154.3562102, aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:25:54 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] VM Started (Lifecycle Event)
Apr 11 19:25:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:25:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:25:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:25:55 user nova-compute[82196]: INFO nova.compute.claims [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Claim successful on node user
Apr 11 19:25:56 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:25:56 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:25:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:25:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:25:56 user nova-compute[82196]: DEBUG nova.network.neutron [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:25:56 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:25:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:25:56 user nova-compute[82196]: DEBUG nova.policy [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a32a5d0547141a180f655e98567ed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bceca6e3506e43f68f9cf8d0b56d141b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:25:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:25:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:25:56 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Creating image(s)
Apr 11 19:25:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "/opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "/opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "/opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3.part --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:57 user nova-compute[82196]: DEBUG nova.network.neutron [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Successfully created port: 77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:25:57 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241142.4875934, 53ccc829-6323-48ec-b63f-9de9bc607456 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:25:57 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] VM Stopped (Lifecycle Event)
Apr 11 19:25:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7e8b638f-d3a9-4fbf-b52f-4e91d74184e4 None None] [instance: 53ccc829-6323-48ec-b63f-9de9bc607456] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:25:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3.part --force-share --output=json" returned: 0 in 0.153s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:57 user nova-compute[82196]: DEBUG nova.virt.images [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] d7d799c2-1b6d-4055-a3ab-a4130305113e was qcow2, converting to raw {{(pid=82196) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 19:25:57 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:25:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3.part /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3.converted {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3.part /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3.converted" returned: 0 in 0.215s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3.converted --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.310s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3 --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.network.neutron [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Successfully updated port: 77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3 --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3,backing_fmt=raw /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Received event network-changed-77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Refreshing instance network info cache due to event network-changed-77bd0f58-75d0-4cc3-ab98-4f4b31401482. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] Acquiring lock "refresh_cache-f37ed08c-8c9a-4af7-ba5f-b8a942e54389" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] Acquired lock "refresh_cache-f37ed08c-8c9a-4af7-ba5f-b8a942e54389" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.network.neutron [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Refreshing network info cache for port 77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "refresh_cache-f37ed08c-8c9a-4af7-ba5f-b8a942e54389" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3,backing_fmt=raw /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk 1073741824" returned: 0 in 0.068s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.network.neutron [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3 --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'migration_context' on Instance uuid f37ed08c-8c9a-4af7-ba5f-b8a942e54389 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Ensure instance console log exists: /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.network.neutron [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bd6c051e-f996-4f5a-80f5-0194213b01cd req-6ddd064b-8535-4741-817e-8d570ccb08b7 service nova] Releasing lock "refresh_cache-f37ed08c-8c9a-4af7-ba5f-b8a942e54389" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquired lock "refresh_cache-f37ed08c-8c9a-4af7-ba5f-b8a942e54389" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.network.neutron [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.network.neutron [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.network.neutron [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Updating instance_info_cache with network_info: [{"id": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "address": "fa:16:3e:7e:08:f3", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77bd0f58-75", "ovs_interfaceid": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Releasing lock "refresh_cache-f37ed08c-8c9a-4af7-ba5f-b8a942e54389" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Instance network_info: |[{"id": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "address": "fa:16:3e:7e:08:f3", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77bd0f58-75", "ovs_interfaceid": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Start _get_guest_xml network_info=[{"id": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "address": "fa:16:3e:7e:08:f3", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77bd0f58-75", "ovs_interfaceid": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='bb9686225b20014c304bf3f590e8742b',container_format='bare',created_at=2023-04-11T19:25:44Z,direct_url=<?>,disk_format='qcow2',id=d7d799c2-1b6d-4055-a3ab-a4130305113e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1444549245',owner='bceca6e3506e43f68f9cf8d0b56d141b',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T19:25:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'd7d799c2-1b6d-4055-a3ab-a4130305113e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:25:58 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:25:58 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bb9686225b20014c304bf3f590e8742b',container_format='bare',created_at=2023-04-11T19:25:44Z,direct_url=<?>,disk_format='qcow2',id=d7d799c2-1b6d-4055-a3ab-a4130305113e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1444549245',owner='bceca6e3506e43f68f9cf8d0b56d141b',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T19:25:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:25:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-222957451',display_name='tempest-TestStampPattern-server-222957451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-222957451',id=19,image_ref='d7d799c2-1b6d-4055-a3ab-a4130305113e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk/F931FMuqnj9QLMI+pGBS0j8hrERQZ0hcpFPwqT+C/Srrx02ZenEuPQP/CTs/VLAlwECMwCuedYJB3t1d4C9VnWF3rrxqO6dqYPkLQMKZthDnoCY8H8zWO0Un/+Ismw==',key_name='tempest-TestStampPattern-1385471309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bceca6e3506e43f68f9cf8d0b56d141b',ramdisk_id='',reservation_id='r-s3h1o6hs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d424f88d-5f82-4cac-aa0f-4f99624bd3e7',image_min_disk='1',image_min_ram='0',image_owner_id='bceca6e3506e43f68f9cf8d0b56d141b',image_owner_project_name='tempest-TestStampPattern-497408287',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-497408287-project-member',image_user_id='3a32a5d0547141a180f655e98567ed9a',network_allocated='True',owner_project_name='tempest-TestStampPattern-497408287',owner_user_name='tempest-TestStampPattern-497408287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:25:56Z,user_data=None,user_id='3a32a5d0547141a180f655e98567ed9a',uuid=f37ed08c-8c9a-4af7-ba5f-b8a942e54389,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "address": "fa:16:3e:7e:08:f3", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77bd0f58-75", "ovs_interfaceid": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Converting VIF {"id": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "address": "fa:16:3e:7e:08:f3", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77bd0f58-75", "ovs_interfaceid": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:08:f3,bridge_name='br-int',has_traffic_filtering=True,id=77bd0f58-75d0-4cc3-ab98-4f4b31401482,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77bd0f58-75') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'pci_devices' on Instance uuid f37ed08c-8c9a-4af7-ba5f-b8a942e54389 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:25:59 user nova-compute[82196]:   <uuid>f37ed08c-8c9a-4af7-ba5f-b8a942e54389</uuid>
Apr 11 19:25:59 user nova-compute[82196]:   <name>instance-00000013</name>
Apr 11 19:25:59 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:25:59 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:25:59 user nova-compute[82196]:   <metadata>
Apr 11 19:25:59 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:25:59 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:25:59 user nova-compute[82196]:       <nova:name>tempest-TestStampPattern-server-222957451</nova:name>
Apr 11 19:25:59 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:25:58</nova:creationTime>
Apr 11 19:25:59 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:25:59 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:25:59 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:25:59 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:25:59 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:25:59 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:25:59 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:25:59 user nova-compute[82196]:       <nova:owner>
Apr 11 19:25:59 user nova-compute[82196]:         <nova:user uuid="3a32a5d0547141a180f655e98567ed9a">tempest-TestStampPattern-497408287-project-member</nova:user>
Apr 11 19:25:59 user nova-compute[82196]:         <nova:project uuid="bceca6e3506e43f68f9cf8d0b56d141b">tempest-TestStampPattern-497408287</nova:project>
Apr 11 19:25:59 user nova-compute[82196]:       </nova:owner>
Apr 11 19:25:59 user nova-compute[82196]:       <nova:root type="image" uuid="d7d799c2-1b6d-4055-a3ab-a4130305113e"/>
Apr 11 19:25:59 user nova-compute[82196]:       <nova:ports>
Apr 11 19:25:59 user nova-compute[82196]:         <nova:port uuid="77bd0f58-75d0-4cc3-ab98-4f4b31401482">
Apr 11 19:25:59 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 19:25:59 user nova-compute[82196]:         </nova:port>
Apr 11 19:25:59 user nova-compute[82196]:       </nova:ports>
Apr 11 19:25:59 user nova-compute[82196]:     </nova:instance>
Apr 11 19:25:59 user nova-compute[82196]:   </metadata>
Apr 11 19:25:59 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:25:59 user nova-compute[82196]:     <system>
Apr 11 19:25:59 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:25:59 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:25:59 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:25:59 user nova-compute[82196]:       <entry name="serial">f37ed08c-8c9a-4af7-ba5f-b8a942e54389</entry>
Apr 11 19:25:59 user nova-compute[82196]:       <entry name="uuid">f37ed08c-8c9a-4af7-ba5f-b8a942e54389</entry>
Apr 11 19:25:59 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:25:59 user nova-compute[82196]:     </system>
Apr 11 19:25:59 user nova-compute[82196]:   </sysinfo>
Apr 11 19:25:59 user nova-compute[82196]:   <os>
Apr 11 19:25:59 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:25:59 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:25:59 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:25:59 user nova-compute[82196]:   </os>
Apr 11 19:25:59 user nova-compute[82196]:   <features>
Apr 11 19:25:59 user nova-compute[82196]:     <acpi/>
Apr 11 19:25:59 user nova-compute[82196]:     <apic/>
Apr 11 19:25:59 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:25:59 user nova-compute[82196]:   </features>
Apr 11 19:25:59 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:25:59 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:25:59 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:25:59 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:25:59 user nova-compute[82196]:   </clock>
Apr 11 19:25:59 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:25:59 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:25:59 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:25:59 user nova-compute[82196]:   </cpu>
Apr 11 19:25:59 user nova-compute[82196]:   <devices>
Apr 11 19:25:59 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:25:59 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:25:59 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk"/>
Apr 11 19:25:59 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:25:59 user nova-compute[82196]:     </disk>
Apr 11 19:25:59 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:25:59 user nova-compute[82196]:       <mac address="fa:16:3e:7e:08:f3"/>
Apr 11 19:25:59 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:25:59 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:25:59 user nova-compute[82196]:       <target dev="tap77bd0f58-75"/>
Apr 11 19:25:59 user nova-compute[82196]:     </interface>
Apr 11 19:25:59 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:25:59 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/console.log" append="off"/>
Apr 11 19:25:59 user nova-compute[82196]:     </serial>
Apr 11 19:25:59 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:25:59 user nova-compute[82196]:     <video>
Apr 11 19:25:59 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:25:59 user nova-compute[82196]:     </video>
Apr 11 19:25:59 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:25:59 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:25:59 user nova-compute[82196]:     </rng>
Apr 11 19:25:59 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:25:59 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:25:59 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:25:59 user nova-compute[82196]:     </memballoon>
Apr 11 19:25:59 user nova-compute[82196]:   </devices>
Apr 11 19:25:59 user nova-compute[82196]: </domain>
Apr 11 19:25:59 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-222957451',display_name='tempest-TestStampPattern-server-222957451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-222957451',id=19,image_ref='d7d799c2-1b6d-4055-a3ab-a4130305113e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk/F931FMuqnj9QLMI+pGBS0j8hrERQZ0hcpFPwqT+C/Srrx02ZenEuPQP/CTs/VLAlwECMwCuedYJB3t1d4C9VnWF3rrxqO6dqYPkLQMKZthDnoCY8H8zWO0Un/+Ismw==',key_name='tempest-TestStampPattern-1385471309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bceca6e3506e43f68f9cf8d0b56d141b',ramdisk_id='',reservation_id='r-s3h1o6hs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d424f88d-5f82-4cac-aa0f-4f99624bd3e7',image_min_disk='1',image_min_ram='0',image_owner_id='bceca6e3506e43f68f9cf8d0b56d141b',image_owner_project_name='tempest-TestStampPattern-497408287',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-497408287-project-member',image_user_id='3a32a5d0547141a180f655e98567ed9a',network_allocated='True',owner_project_name='tempest-TestStampPattern-497408287',owner_user_name='tempest-TestStampPattern-497408287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:25:56Z,user_data=None,user_id='3a32a5d0547141a180f655e98567ed9a',uuid=f37ed08c-8c9a-4af7-ba5f-b8a942e54389,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "address": "fa:16:3e:7e:08:f3", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77bd0f58-75", "ovs_interfaceid": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Converting VIF {"id": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "address": "fa:16:3e:7e:08:f3", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77bd0f58-75", "ovs_interfaceid": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:08:f3,bridge_name='br-int',has_traffic_filtering=True,id=77bd0f58-75d0-4cc3-ab98-4f4b31401482,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77bd0f58-75') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG os_vif [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:08:f3,bridge_name='br-int',has_traffic_filtering=True,id=77bd0f58-75d0-4cc3-ab98-4f4b31401482,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77bd0f58-75') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77bd0f58-75, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77bd0f58-75, col_values=(('external_ids', {'iface-id': '77bd0f58-75d0-4cc3-ab98-4f4b31401482', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:08:f3', 'vm-uuid': 'f37ed08c-8c9a-4af7-ba5f-b8a942e54389'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:25:59 user nova-compute[82196]: INFO os_vif [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:08:f3,bridge_name='br-int',has_traffic_filtering=True,id=77bd0f58-75d0-4cc3-ab98-4f4b31401482,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77bd0f58-75')
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] No VIF found with MAC fa:16:3e:7e:08:f3, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:25:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-3e97d7c3-df00-4096-9067-ff2799c27d4a req-629e1139-ee9a-48f7-9808-d32d36e9b3c0 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Received event network-vif-plugged-77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3e97d7c3-df00-4096-9067-ff2799c27d4a req-629e1139-ee9a-48f7-9808-d32d36e9b3c0 service nova] Acquiring lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3e97d7c3-df00-4096-9067-ff2799c27d4a req-629e1139-ee9a-48f7-9808-d32d36e9b3c0 service nova] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3e97d7c3-df00-4096-9067-ff2799c27d4a req-629e1139-ee9a-48f7-9808-d32d36e9b3c0 service nova] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-3e97d7c3-df00-4096-9067-ff2799c27d4a req-629e1139-ee9a-48f7-9808-d32d36e9b3c0 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] No waiting events found dispatching network-vif-plugged-77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:26:00 user nova-compute[82196]: WARNING nova.compute.manager [req-3e97d7c3-df00-4096-9067-ff2799c27d4a req-629e1139-ee9a-48f7-9808-d32d36e9b3c0 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Received unexpected event network-vif-plugged-77bd0f58-75d0-4cc3-ab98-4f4b31401482 for instance with vm_state building and task_state spawning.
Apr 11 19:26:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241162.7114906, f37ed08c-8c9a-4af7-ba5f-b8a942e54389 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:26:02 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] VM Resumed (Lifecycle Event)
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:26:02 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Instance spawned successfully.
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-ad2485e0-de87-42bb-8239-e742f7f76429 req-48e46c55-7719-4ae0-84fc-a986c8825f41 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Received event network-vif-plugged-77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ad2485e0-de87-42bb-8239-e742f7f76429 req-48e46c55-7719-4ae0-84fc-a986c8825f41 service nova] Acquiring lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ad2485e0-de87-42bb-8239-e742f7f76429 req-48e46c55-7719-4ae0-84fc-a986c8825f41 service nova] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ad2485e0-de87-42bb-8239-e742f7f76429 req-48e46c55-7719-4ae0-84fc-a986c8825f41 service nova] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-ad2485e0-de87-42bb-8239-e742f7f76429 req-48e46c55-7719-4ae0-84fc-a986c8825f41 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] No waiting events found dispatching network-vif-plugged-77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:26:02 user nova-compute[82196]: WARNING nova.compute.manager [req-ad2485e0-de87-42bb-8239-e742f7f76429 req-48e46c55-7719-4ae0-84fc-a986c8825f41 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Received unexpected event network-vif-plugged-77bd0f58-75d0-4cc3-ab98-4f4b31401482 for instance with vm_state building and task_state spawning.
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:26:02 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241162.7195597, f37ed08c-8c9a-4af7-ba5f-b8a942e54389 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:26:02 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] VM Started (Lifecycle Event)
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:26:02 user nova-compute[82196]: INFO nova.compute.manager [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Took 6.26 seconds to spawn the instance on the hypervisor.
Apr 11 19:26:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:26:02 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:26:02 user nova-compute[82196]: INFO nova.compute.manager [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Took 7.10 seconds to build instance.
Apr 11 19:26:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7cce4d5-88dc-4a21-a230-299eb2190bd4 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.205s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:33 user nova-compute[82196]: INFO nova.compute.manager [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Detaching volume 4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:26:33 user nova-compute[82196]: INFO nova.virt.block_device [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Attempting to driver detach volume 4940d74f-b60a-49aa-bf74-4e000efa8dc5 from mountpoint /dev/vdb
Apr 11 19:26:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Attempting to detach device vdb from instance bed4001c-02c2-4c6b-84c8-61654df66d8b from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:26:33 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:26:33 user nova-compute[82196]:   <source dev="/dev/sdh"/>
Apr 11 19:26:33 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:26:33 user nova-compute[82196]:   <serial>4940d74f-b60a-49aa-bf74-4e000efa8dc5</serial>
Apr 11 19:26:33 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:26:33 user nova-compute[82196]: </disk>
Apr 11 19:26:33 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:26:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully detached device vdb from instance bed4001c-02c2-4c6b-84c8-61654df66d8b from the persistent domain config.
Apr 11 19:26:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bed4001c-02c2-4c6b-84c8-61654df66d8b from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:26:33 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:26:33 user nova-compute[82196]:   <source dev="/dev/sdh"/>
Apr 11 19:26:33 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:26:33 user nova-compute[82196]:   <serial>4940d74f-b60a-49aa-bf74-4e000efa8dc5</serial>
Apr 11 19:26:33 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:26:33 user nova-compute[82196]: </disk>
Apr 11 19:26:33 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241193.9211628, bed4001c-02c2-4c6b-84c8-61654df66d8b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bed4001c-02c2-4c6b-84c8-61654df66d8b {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:26:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully detached device vdb from instance bed4001c-02c2-4c6b-84c8-61654df66d8b from the live domain config.
Apr 11 19:26:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htgdusmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:26:33 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:26:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d7e5f8-1df9-4445-965f-bf5b1ac2f274]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:26:33 user nova-compute[82196]: No targets found.
Apr 11 19:26:33 user nova-compute[82196]: iSNS:
Apr 11 19:26:33 user nova-compute[82196]: No targets found.
Apr 11 19:26:33 user nova-compute[82196]: STATIC:
Apr 11 19:26:33 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5
Apr 11 19:26:33 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:26:33 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:26:33 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061
Apr 11 19:26:33 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:26:33 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:26:33 user nova-compute[82196]: FIRMWARE:
Apr 11 19:26:33 user nova-compute[82196]: No targets found.
Apr 11 19:26:33 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:26:33 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:26:33 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f49be25-48ff-47b9-b7e0-6e9d350537dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c67c3a3-b4c2-456a-b4b6-bb05b7787a49]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:26:34 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:26:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:26:34 user nova-compute[82196]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 (non-flash)
Apr 11 19:26:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f924073b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5'): ({'sdh'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Removing single pathed devices sdh {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a5a7b4-ad2d-4d05-af0e-ff8439f77a0c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.039s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a170d222-2409-46a6-9b95-216c0f33bfd5]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flushing IO for device /dev/sdh {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf79351-1c99-4b39-903a-64b18e0fdaf9]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe22ba3-e2af-46cd-b479-9dbf625976c7]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] SCSI volumes sdh have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aea7eee-bcbd-4f01-bc6d-58fe3b9fba91]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6443e7ed-1cc7-42f5-aca5-929423746186]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5, portal: 172.16.0.220,3260]
Apr 11 19:26:34 user nova-compute[82196]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5, portal: 172.16.0.220,3260] successful.
Apr 11 19:26:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4940d74f-b60a-49aa-bf74-4e000efa8dc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b89ee3a-6aa2-4e4b-9624-c509f150df26]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] <== disconnect_volume: return (357ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'flavor' on Instance uuid bed4001c-02c2-4c6b-84c8-61654df66d8b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:26:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-73e99670-369a-41d3-b099-726f929f954a tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.976s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "720c683f-c03a-444c-92a8-daf97c9f524b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:26:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:26:35 user nova-compute[82196]: INFO nova.compute.claims [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Claim successful on node user
Apr 11 19:26:36 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:26:36 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:26:36 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:26:36 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Creating image(s)
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "/opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "/opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "/opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG nova.policy [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.153s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk 1073741824" returned: 0 in 0.058s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.149s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Cannot resize image /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG nova.objects.instance [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'migration_context' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Ensure instance console log exists: /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Successfully created port: 9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:26:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-changed-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Refreshing instance network info cache due to event network-changed-6193819b-0c1b-476b-b89e-dbbfc7938fc5. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] Acquiring lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] Acquired lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG nova.network.neutron [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Refreshing network info cache for port 6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Successfully updated port: 9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquired lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-changed-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Refreshing instance network info cache due to event network-changed-9e6087aa-464a-450d-bd04-2653d9420094. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] Acquiring lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG nova.network.neutron [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Updated VIF entry in instance network info cache for port 6193819b-0c1b-476b-b89e-dbbfc7938fc5. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG nova.network.neutron [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Updating instance_info_cache with network_info: [{"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e5f5dd75-fff3-4193-be87-29979b977aa7 req-04ebb423-3eec-444f-bc21-b036bbf41b91 service nova] Releasing lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:26:38 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updating instance_info_cache with network_info: [{"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Releasing lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Instance network_info: |[{"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] Acquired lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.network.neutron [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Refreshing network info cache for port 9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Start _get_guest_xml network_info=[{"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:26:39 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:26:39 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1219064691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1219064691',id=20,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ82RBzB/1/A3FnM1xLWpDXU/zavewAraCLhBOFMjSAT73wEadTAAV/T3F8H/2XBNIlxPBMghQi8EI/lCPJr4+3PB4NLUhilDnSU8CjIwDu129bM+5w7HZBo//kKOchz0Q==',key_name='tempest-keypair-787762884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d8b189667e34931aa36149620a036e1',ramdisk_id='',reservation_id='r-qvcxbxdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-427928846',owner_user_name='tempest-AttachVolumeShelveTestJSON-427928846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:26:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0558ba5a2b04d36ba2f2411090cc4e4',uuid=720c683f-c03a-444c-92a8-daf97c9f524b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converting VIF {"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.objects.instance [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'pci_devices' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:26:39 user nova-compute[82196]:   <uuid>720c683f-c03a-444c-92a8-daf97c9f524b</uuid>
Apr 11 19:26:39 user nova-compute[82196]:   <name>instance-00000014</name>
Apr 11 19:26:39 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:26:39 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:26:39 user nova-compute[82196]:   <metadata>
Apr 11 19:26:39 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:26:39 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:26:39 user nova-compute[82196]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1219064691</nova:name>
Apr 11 19:26:39 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:26:39</nova:creationTime>
Apr 11 19:26:39 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:26:39 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:26:39 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:26:39 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:26:39 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:26:39 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:26:39 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:26:39 user nova-compute[82196]:       <nova:owner>
Apr 11 19:26:39 user nova-compute[82196]:         <nova:user uuid="e0558ba5a2b04d36ba2f2411090cc4e4">tempest-AttachVolumeShelveTestJSON-427928846-project-member</nova:user>
Apr 11 19:26:39 user nova-compute[82196]:         <nova:project uuid="8d8b189667e34931aa36149620a036e1">tempest-AttachVolumeShelveTestJSON-427928846</nova:project>
Apr 11 19:26:39 user nova-compute[82196]:       </nova:owner>
Apr 11 19:26:39 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:26:39 user nova-compute[82196]:       <nova:ports>
Apr 11 19:26:39 user nova-compute[82196]:         <nova:port uuid="9e6087aa-464a-450d-bd04-2653d9420094">
Apr 11 19:26:39 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 19:26:39 user nova-compute[82196]:         </nova:port>
Apr 11 19:26:39 user nova-compute[82196]:       </nova:ports>
Apr 11 19:26:39 user nova-compute[82196]:     </nova:instance>
Apr 11 19:26:39 user nova-compute[82196]:   </metadata>
Apr 11 19:26:39 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:26:39 user nova-compute[82196]:     <system>
Apr 11 19:26:39 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:26:39 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:26:39 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:26:39 user nova-compute[82196]:       <entry name="serial">720c683f-c03a-444c-92a8-daf97c9f524b</entry>
Apr 11 19:26:39 user nova-compute[82196]:       <entry name="uuid">720c683f-c03a-444c-92a8-daf97c9f524b</entry>
Apr 11 19:26:39 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:26:39 user nova-compute[82196]:     </system>
Apr 11 19:26:39 user nova-compute[82196]:   </sysinfo>
Apr 11 19:26:39 user nova-compute[82196]:   <os>
Apr 11 19:26:39 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:26:39 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:26:39 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:26:39 user nova-compute[82196]:   </os>
Apr 11 19:26:39 user nova-compute[82196]:   <features>
Apr 11 19:26:39 user nova-compute[82196]:     <acpi/>
Apr 11 19:26:39 user nova-compute[82196]:     <apic/>
Apr 11 19:26:39 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:26:39 user nova-compute[82196]:   </features>
Apr 11 19:26:39 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:26:39 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:26:39 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:26:39 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:26:39 user nova-compute[82196]:   </clock>
Apr 11 19:26:39 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:26:39 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:26:39 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:26:39 user nova-compute[82196]:   </cpu>
Apr 11 19:26:39 user nova-compute[82196]:   <devices>
Apr 11 19:26:39 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:26:39 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:26:39 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk"/>
Apr 11 19:26:39 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:26:39 user nova-compute[82196]:     </disk>
Apr 11 19:26:39 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:26:39 user nova-compute[82196]:       <mac address="fa:16:3e:c8:24:ee"/>
Apr 11 19:26:39 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:26:39 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:26:39 user nova-compute[82196]:       <target dev="tap9e6087aa-46"/>
Apr 11 19:26:39 user nova-compute[82196]:     </interface>
Apr 11 19:26:39 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:26:39 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/console.log" append="off"/>
Apr 11 19:26:39 user nova-compute[82196]:     </serial>
Apr 11 19:26:39 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:26:39 user nova-compute[82196]:     <video>
Apr 11 19:26:39 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:26:39 user nova-compute[82196]:     </video>
Apr 11 19:26:39 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:26:39 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:26:39 user nova-compute[82196]:     </rng>
Apr 11 19:26:39 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:26:39 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:26:39 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:26:39 user nova-compute[82196]:     </memballoon>
Apr 11 19:26:39 user nova-compute[82196]:   </devices>
Apr 11 19:26:39 user nova-compute[82196]: </domain>
Apr 11 19:26:39 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1219064691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1219064691',id=20,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ82RBzB/1/A3FnM1xLWpDXU/zavewAraCLhBOFMjSAT73wEadTAAV/T3F8H/2XBNIlxPBMghQi8EI/lCPJr4+3PB4NLUhilDnSU8CjIwDu129bM+5w7HZBo//kKOchz0Q==',key_name='tempest-keypair-787762884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d8b189667e34931aa36149620a036e1',ramdisk_id='',reservation_id='r-qvcxbxdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-427928846',owner_user_name='tempest-AttachVolumeShelveTestJSON-427928846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:26:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0558ba5a2b04d36ba2f2411090cc4e4',uuid=720c683f-c03a-444c-92a8-daf97c9f524b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converting VIF {"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG os_vif [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e6087aa-46, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e6087aa-46, col_values=(('external_ids', {'iface-id': '9e6087aa-464a-450d-bd04-2653d9420094', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:24:ee', 'vm-uuid': '720c683f-c03a-444c-92a8-daf97c9f524b'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:39 user nova-compute[82196]: INFO os_vif [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46')
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] No VIF found with MAC fa:16:3e:c8:24:ee, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.network.neutron [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updated VIF entry in instance network info cache for port 9e6087aa-464a-450d-bd04-2653d9420094. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.network.neutron [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updating instance_info_cache with network_info: [{"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-17c31520-47ef-4f85-8468-e19c45681d1a req-4b27eb07-b661-4de4-8b71-e7c8ea12a65b service nova] Releasing lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG nova.objects.instance [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:26:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:40 user nova-compute[82196]: INFO nova.compute.manager [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Attaching volume ae9e623b-e20a-47f6-8a7b-d48a85701e3e to /dev/vdb
Apr 11 19:26:40 user nova-compute[82196]: DEBUG os_brick.utils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec2b370-5bf8-47f4-b020-9f90b57c808e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[603d86da-7624-4bb9-ba6b-96595c38e413]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93471cc-4b86-4cc9-abaa-66073919acc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03a1cb0-62b0-4756-ad6d-a2e6f5e28b07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:26:40 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:26:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b163ead-ab0d-49c4-b90d-300d0fe5bd87]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG os_brick.utils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Updating existing volume attachment record: a3872eae-51fd-4839-9e88-24e5f7d598a3 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-d336c825-d932-4839-8b67-5a0d6376fec9 req-45b20040-5ea7-43e7-8aee-9e57bb22b4e1 service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d336c825-d932-4839-8b67-5a0d6376fec9 req-45b20040-5ea7-43e7-8aee-9e57bb22b4e1 service nova] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d336c825-d932-4839-8b67-5a0d6376fec9 req-45b20040-5ea7-43e7-8aee-9e57bb22b4e1 service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d336c825-d932-4839-8b67-5a0d6376fec9 req-45b20040-5ea7-43e7-8aee-9e57bb22b4e1 service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-d336c825-d932-4839-8b67-5a0d6376fec9 req-45b20040-5ea7-43e7-8aee-9e57bb22b4e1 service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] No waiting events found dispatching network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:26:41 user nova-compute[82196]: WARNING nova.compute.manager [req-d336c825-d932-4839-8b67-5a0d6376fec9 req-45b20040-5ea7-43e7-8aee-9e57bb22b4e1 service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received unexpected event network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 for instance with vm_state building and task_state spawning.
Apr 11 19:26:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241203.0568333, 720c683f-c03a-444c-92a8-daf97c9f524b => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:26:43 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] VM Resumed (Lifecycle Event)
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:26:43 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Instance spawned successfully.
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:43 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241203.0650735, 720c683f-c03a-444c-92a8-daf97c9f524b => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:26:43 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] VM Started (Lifecycle Event)
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-150d1bfe-bf8e-468a-9924-35ea834eeb47 req-017fb6da-0a8d-48ee-913e-e6d71b185833 service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-150d1bfe-bf8e-468a-9924-35ea834eeb47 req-017fb6da-0a8d-48ee-913e-e6d71b185833 service nova] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-150d1bfe-bf8e-468a-9924-35ea834eeb47 req-017fb6da-0a8d-48ee-913e-e6d71b185833 service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-150d1bfe-bf8e-468a-9924-35ea834eeb47 req-017fb6da-0a8d-48ee-913e-e6d71b185833 service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-150d1bfe-bf8e-468a-9924-35ea834eeb47 req-017fb6da-0a8d-48ee-913e-e6d71b185833 service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] No waiting events found dispatching network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:26:43 user nova-compute[82196]: WARNING nova.compute.manager [req-150d1bfe-bf8e-468a-9924-35ea834eeb47 req-017fb6da-0a8d-48ee-913e-e6d71b185833 service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received unexpected event network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 for instance with vm_state building and task_state spawning.
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:26:43 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:26:43 user nova-compute[82196]: INFO nova.compute.manager [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Took 7.03 seconds to spawn the instance on the hypervisor.
Apr 11 19:26:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:26:43 user nova-compute[82196]: INFO nova.compute.manager [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Took 8.03 seconds to build instance.
Apr 11 19:26:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6b72bff-d6fd-4373-a498-2051409de62f tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "720c683f-c03a-444c-92a8-daf97c9f524b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.142s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:26:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKWyAxXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:26:44 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:26:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:26:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:26:44 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:26:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:26:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:26:44 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:26:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87e9891-5ee2-4076-9b3f-3e5a890e801a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:26:45 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f49e1c-1410-4b86-a8fd-10629e0179a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e] added
Apr 11 19:26:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fdb102-8fba-4888-b5bd-08693f4f9bab]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ffb231-aebb-45f5-a4a7-8e39bf687c94]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKWyAxXC {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKWyAxXC" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea04273-92dc-4efc-bbc5-2a0aecaad677]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JKWyAxXC'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[750486a9-c0de-42c3-b89e-2fd45c7934fc]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[964f748a-17de-446d-bdb0-e5c311576908]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:26:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:26:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3038e0e4-4a02-4795-8af7-1fd0114c38f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260]
Apr 11 19:26:45 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260] successful.
Apr 11 19:26:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76fbe19-506f-4195-b635-809db66f819d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c350d-4893-4821-8a72-0ae1c70caa59]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:26:45 user nova-compute[82196]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:26:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:26:45 user nova-compute[82196]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:26:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f52de7f-c7ab-48d4-81eb-82002f4b03cd]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: None {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:26:45 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-9941d033-15c2-4069-b9a6-f80840e95a38" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-9941d033-15c2-4069-b9a6-f80840e95a38" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKWyAxXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26235306430343930', 'path': '/dev/sdc'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235306430343930', 'path': '/dev/sdc'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG nova.objects.instance [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:26:46 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:26:46 user nova-compute[82196]:   <source dev="/dev/sdc"/>
Apr 11 19:26:46 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:26:46 user nova-compute[82196]:   <serial>ae9e623b-e20a-47f6-8a7b-d48a85701e3e</serial>
Apr 11 19:26:46 user nova-compute[82196]: </disk>
Apr 11 19:26:46 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No VIF found with MAC fa:16:3e:ce:17:72, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Updating instance_info_cache with network_info: [{"id": "031df3cc-5433-459d-ab9b-484629289e90", "address": "fa:16:3e:b6:4d:98", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031df3cc-54", "ovs_interfaceid": "031df3cc-5433-459d-ab9b-484629289e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-9941d033-15c2-4069-b9a6-f80840e95a38" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:26:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7ca76eee-d8b4-4184-a299-8aff63a73dde tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.913s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG nova.compute.manager [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG nova.compute.manager [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82196) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 19:26:47 user nova-compute[82196]: DEBUG nova.objects.instance [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-532f076b-899d-4e1d-8435-c0dd40a17483 req-5060b168-05fe-4af6-a3ba-209e5043eefd service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-unplugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-532f076b-899d-4e1d-8435-c0dd40a17483 req-5060b168-05fe-4af6-a3ba-209e5043eefd service nova] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-532f076b-899d-4e1d-8435-c0dd40a17483 req-5060b168-05fe-4af6-a3ba-209e5043eefd service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-532f076b-899d-4e1d-8435-c0dd40a17483 req-5060b168-05fe-4af6-a3ba-209e5043eefd service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-532f076b-899d-4e1d-8435-c0dd40a17483 req-5060b168-05fe-4af6-a3ba-209e5043eefd service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] No waiting events found dispatching network-vif-unplugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:26:48 user nova-compute[82196]: WARNING nova.compute.manager [req-532f076b-899d-4e1d-8435-c0dd40a17483 req-5060b168-05fe-4af6-a3ba-209e5043eefd service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received unexpected event network-vif-unplugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance with vm_state active and task_state powering-off.
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:48 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance destroyed successfully.
Apr 11 19:26:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-81f1074c-825c-446e-802d-2af426d9b7f0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.946s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG nova.compute.manager [req-abde3b6a-5947-425b-acfc-d9a4da595fa7 req-f30c6a6e-614e-4602-ae22-643f265cc5cf service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-abde3b6a-5947-425b-acfc-d9a4da595fa7 req-f30c6a6e-614e-4602-ae22-643f265cc5cf service nova] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-abde3b6a-5947-425b-acfc-d9a4da595fa7 req-f30c6a6e-614e-4602-ae22-643f265cc5cf service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-abde3b6a-5947-425b-acfc-d9a4da595fa7 req-f30c6a6e-614e-4602-ae22-643f265cc5cf service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG nova.compute.manager [req-abde3b6a-5947-425b-acfc-d9a4da595fa7 req-f30c6a6e-614e-4602-ae22-643f265cc5cf service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] No waiting events found dispatching network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:26:50 user nova-compute[82196]: WARNING nova.compute.manager [req-abde3b6a-5947-425b-acfc-d9a4da595fa7 req-f30c6a6e-614e-4602-ae22-643f265cc5cf service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received unexpected event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance with vm_state stopped and task_state None.
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:51 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:26:51 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7387MB free_disk=26.353839874267578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bed4001c-02c2-4c6b-84c8-61654df66d8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9941d033-15c2-4069-b9a6-f80840e95a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6802f099-9236-4c79-a892-2963f1b15b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance ac961841-1fc4-4cec-89bd-8f932270441a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 083108da-0a96-4177-8866-66131d77c39b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 720c683f-c03a-444c-92a8-daf97c9f524b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:26:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.208s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:26:52 user nova-compute[82196]: INFO nova.compute.claims [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Claim successful on node user
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:26:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.policy [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:26:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Creating image(s)
Apr 11 19:26:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk 1073741824" returned: 0 in 0.050s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Successfully created port: e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Cannot resize image /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG nova.objects.instance [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'migration_context' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Ensure instance console log exists: /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.network.neutron [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Successfully updated port: e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquired lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.network.neutron [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-changed-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Refreshing instance network info cache due to event network-changed-e4e4888a-168a-4fe8-a43e-ee683b50a39a. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] Acquiring lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.network.neutron [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.network.neutron [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating instance_info_cache with network_info: [{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Releasing lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance network_info: |[{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] Acquired lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Refreshing network info cache for port e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Start _get_guest_xml network_info=[{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:26:54 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:26:54 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-505347267',display_name='tempest-ServerActionsTestJSON-server-505347267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-505347267',id=21,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-lxpjy0l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=647674d8-af53-405a-8116-4b7a01549bdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.objects.instance [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'pci_devices' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:26:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:26:54 user nova-compute[82196]:   <uuid>647674d8-af53-405a-8116-4b7a01549bdf</uuid>
Apr 11 19:26:54 user nova-compute[82196]:   <name>instance-00000015</name>
Apr 11 19:26:54 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:26:54 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:26:54 user nova-compute[82196]:   <metadata>
Apr 11 19:26:54 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:26:54 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:26:54 user nova-compute[82196]:       <nova:name>tempest-ServerActionsTestJSON-server-505347267</nova:name>
Apr 11 19:26:54 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:26:54</nova:creationTime>
Apr 11 19:26:54 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:26:54 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:26:54 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:26:54 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:26:54 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:26:54 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:26:54 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:26:54 user nova-compute[82196]:       <nova:owner>
Apr 11 19:26:54 user nova-compute[82196]:         <nova:user uuid="05fb551c320a48f98a4ec00a7f7492d7">tempest-ServerActionsTestJSON-37730514-project-member</nova:user>
Apr 11 19:26:54 user nova-compute[82196]:         <nova:project uuid="60a7381a31b84e97a068528f90813773">tempest-ServerActionsTestJSON-37730514</nova:project>
Apr 11 19:26:54 user nova-compute[82196]:       </nova:owner>
Apr 11 19:26:54 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:26:54 user nova-compute[82196]:       <nova:ports>
Apr 11 19:26:54 user nova-compute[82196]:         <nova:port uuid="e4e4888a-168a-4fe8-a43e-ee683b50a39a">
Apr 11 19:26:54 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 19:26:54 user nova-compute[82196]:         </nova:port>
Apr 11 19:26:54 user nova-compute[82196]:       </nova:ports>
Apr 11 19:26:54 user nova-compute[82196]:     </nova:instance>
Apr 11 19:26:54 user nova-compute[82196]:   </metadata>
Apr 11 19:26:54 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:26:54 user nova-compute[82196]:     <system>
Apr 11 19:26:54 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:26:54 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:26:54 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:26:54 user nova-compute[82196]:       <entry name="serial">647674d8-af53-405a-8116-4b7a01549bdf</entry>
Apr 11 19:26:54 user nova-compute[82196]:       <entry name="uuid">647674d8-af53-405a-8116-4b7a01549bdf</entry>
Apr 11 19:26:54 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:26:54 user nova-compute[82196]:     </system>
Apr 11 19:26:54 user nova-compute[82196]:   </sysinfo>
Apr 11 19:26:54 user nova-compute[82196]:   <os>
Apr 11 19:26:54 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:26:54 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:26:54 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:26:54 user nova-compute[82196]:   </os>
Apr 11 19:26:54 user nova-compute[82196]:   <features>
Apr 11 19:26:54 user nova-compute[82196]:     <acpi/>
Apr 11 19:26:54 user nova-compute[82196]:     <apic/>
Apr 11 19:26:54 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:26:54 user nova-compute[82196]:   </features>
Apr 11 19:26:54 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:26:54 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:26:54 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:26:54 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:26:54 user nova-compute[82196]:   </clock>
Apr 11 19:26:54 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:26:54 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:26:54 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:26:54 user nova-compute[82196]:   </cpu>
Apr 11 19:26:54 user nova-compute[82196]:   <devices>
Apr 11 19:26:54 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:26:54 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:26:54 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk"/>
Apr 11 19:26:54 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:26:54 user nova-compute[82196]:     </disk>
Apr 11 19:26:54 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:26:54 user nova-compute[82196]:       <mac address="fa:16:3e:7a:ec:62"/>
Apr 11 19:26:54 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:26:54 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:26:54 user nova-compute[82196]:       <target dev="tape4e4888a-16"/>
Apr 11 19:26:54 user nova-compute[82196]:     </interface>
Apr 11 19:26:54 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:26:54 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/console.log" append="off"/>
Apr 11 19:26:54 user nova-compute[82196]:     </serial>
Apr 11 19:26:54 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:26:54 user nova-compute[82196]:     <video>
Apr 11 19:26:54 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:26:54 user nova-compute[82196]:     </video>
Apr 11 19:26:54 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:26:54 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:26:54 user nova-compute[82196]:     </rng>
Apr 11 19:26:54 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:26:54 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:26:54 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:26:54 user nova-compute[82196]:     </memballoon>
Apr 11 19:26:54 user nova-compute[82196]:   </devices>
Apr 11 19:26:54 user nova-compute[82196]: </domain>
Apr 11 19:26:54 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-505347267',display_name='tempest-ServerActionsTestJSON-server-505347267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-505347267',id=21,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-lxpjy0l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=647674d8-af53-405a-8116-4b7a01549bdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG os_vif [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4e4888a-16, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4e4888a-16, col_values=(('external_ids', {'iface-id': 'e4e4888a-168a-4fe8-a43e-ee683b50a39a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:ec:62', 'vm-uuid': '647674d8-af53-405a-8116-4b7a01549bdf'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:55 user nova-compute[82196]: INFO os_vif [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16')
Apr 11 19:26:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No VIF found with MAC fa:16:3e:7a:ec:62, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG nova.network.neutron [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updated VIF entry in instance network info cache for port e4e4888a-168a-4fe8-a43e-ee683b50a39a. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG nova.network.neutron [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating instance_info_cache with network_info: [{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:26:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f0df4d5e-21ae-4a41-af24-928fd6a02d0b req-16b3b814-82e6-46f2-a949-15bdb9d34043 service nova] Releasing lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-677a9dbb-f514-4789-8836-c5b43312c015 req-03e33ecf-a4b5-4925-ba47-370acaa9ed0f service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-677a9dbb-f514-4789-8836-c5b43312c015 req-03e33ecf-a4b5-4925-ba47-370acaa9ed0f service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-677a9dbb-f514-4789-8836-c5b43312c015 req-03e33ecf-a4b5-4925-ba47-370acaa9ed0f service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-677a9dbb-f514-4789-8836-c5b43312c015 req-03e33ecf-a4b5-4925-ba47-370acaa9ed0f service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-677a9dbb-f514-4789-8836-c5b43312c015 req-03e33ecf-a4b5-4925-ba47-370acaa9ed0f service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:26:56 user nova-compute[82196]: WARNING nova.compute.manager [req-677a9dbb-f514-4789-8836-c5b43312c015 req-03e33ecf-a4b5-4925-ba47-370acaa9ed0f service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state building and task_state spawning.
Apr 11 19:26:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "ac961841-1fc4-4cec-89bd-8f932270441a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "ac961841-1fc4-4cec-89bd-8f932270441a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:57 user nova-compute[82196]: INFO nova.compute.manager [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Terminating instance
Apr 11 19:26:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-7047ebc7-4d95-4c48-93ec-dab9c9e3b065 req-883626bd-162e-40d1-bdbe-cd281d37bac8 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Received event network-vif-unplugged-c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7047ebc7-4d95-4c48-93ec-dab9c9e3b065 req-883626bd-162e-40d1-bdbe-cd281d37bac8 service nova] Acquiring lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7047ebc7-4d95-4c48-93ec-dab9c9e3b065 req-883626bd-162e-40d1-bdbe-cd281d37bac8 service nova] Lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7047ebc7-4d95-4c48-93ec-dab9c9e3b065 req-883626bd-162e-40d1-bdbe-cd281d37bac8 service nova] Lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-7047ebc7-4d95-4c48-93ec-dab9c9e3b065 req-883626bd-162e-40d1-bdbe-cd281d37bac8 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] No waiting events found dispatching network-vif-unplugged-c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-7047ebc7-4d95-4c48-93ec-dab9c9e3b065 req-883626bd-162e-40d1-bdbe-cd281d37bac8 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Received event network-vif-unplugged-c48d7fec-727d-409c-8285-6ae0da5ff14d for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:26:57 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Instance destroyed successfully.
Apr 11 19:26:57 user nova-compute[82196]: DEBUG nova.objects.instance [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lazy-loading 'resources' on Instance uuid ac961841-1fc4-4cec-89bd-8f932270441a {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:25:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1079797334',display_name='tempest-VolumesActionsTest-instance-1079797334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1079797334',id=16,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7543456a70d04d7f8c50f37e64b7ee9c',ramdisk_id='',reservation_id='r-0m7wharo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2124197416',owner_user_name='tempest-VolumesActionsTest-2124197416-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:25:13Z,user_data=None,user_id='7c9641ceb17e4914b1cdf061c5bdc79f',uuid=ac961841-1fc4-4cec-89bd-8f932270441a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "address": "fa:16:3e:05:83:cc", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d7fec-72", "ovs_interfaceid": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Converting VIF {"id": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "address": "fa:16:3e:05:83:cc", "network": {"id": "93340493-e74d-43fd-9b4c-ddd0217720be", "bridge": "br-int", "label": "tempest-VolumesActionsTest-455345742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7543456a70d04d7f8c50f37e64b7ee9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d7fec-72", "ovs_interfaceid": "c48d7fec-727d-409c-8285-6ae0da5ff14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:83:cc,bridge_name='br-int',has_traffic_filtering=True,id=c48d7fec-727d-409c-8285-6ae0da5ff14d,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d7fec-72') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG os_vif [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:83:cc,bridge_name='br-int',has_traffic_filtering=True,id=c48d7fec-727d-409c-8285-6ae0da5ff14d,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d7fec-72') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc48d7fec-72, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:26:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:57 user nova-compute[82196]: INFO os_vif [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:83:cc,bridge_name='br-int',has_traffic_filtering=True,id=c48d7fec-727d-409c-8285-6ae0da5ff14d,network=Network(93340493-e74d-43fd-9b4c-ddd0217720be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d7fec-72')
Apr 11 19:26:57 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Deleting instance files /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a_del
Apr 11 19:26:57 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Deletion of /opt/stack/data/nova/instances/ac961841-1fc4-4cec-89bd-8f932270441a_del complete
Apr 11 19:26:58 user nova-compute[82196]: INFO nova.compute.manager [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 11 19:26:58 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241218.39559, 647674d8-af53-405a-8116-4b7a01549bdf => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:26:58 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] VM Resumed (Lifecycle Event)
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:26:58 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance spawned successfully.
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:26:58 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Took 0.44 seconds to deallocate network for instance.
Apr 11 19:26:58 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241218.395874, 647674d8-af53-405a-8116-4b7a01549bdf => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:26:58 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] VM Started (Lifecycle Event)
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:58 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:26:58 user nova-compute[82196]: INFO nova.compute.manager [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Took 5.70 seconds to spawn the instance on the hypervisor.
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:26:58 user nova-compute[82196]: INFO nova.compute.manager [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Took 6.70 seconds to build instance.
Apr 11 19:26:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b375327-e374-412f-a43e-5d9e9f9a022a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.798s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-3e136e54-8d01-4373-a9fc-ae9570fc8b96 req-3de89ad7-28dd-4d04-9a9b-4ad9ac738318 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3e136e54-8d01-4373-a9fc-ae9570fc8b96 req-3de89ad7-28dd-4d04-9a9b-4ad9ac738318 service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3e136e54-8d01-4373-a9fc-ae9570fc8b96 req-3de89ad7-28dd-4d04-9a9b-4ad9ac738318 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3e136e54-8d01-4373-a9fc-ae9570fc8b96 req-3de89ad7-28dd-4d04-9a9b-4ad9ac738318 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-3e136e54-8d01-4373-a9fc-ae9570fc8b96 req-3de89ad7-28dd-4d04-9a9b-4ad9ac738318 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:26:58 user nova-compute[82196]: WARNING nova.compute.manager [req-3e136e54-8d01-4373-a9fc-ae9570fc8b96 req-3de89ad7-28dd-4d04-9a9b-4ad9ac738318 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state active and task_state None.
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:26:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:58 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Deleted allocations for instance ac961841-1fc4-4cec-89bd-8f932270441a
Apr 11 19:26:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-359ea0f7-794e-40d4-ad65-051e92e0f537 tempest-VolumesActionsTest-2124197416 tempest-VolumesActionsTest-2124197416-project-member] Lock "ac961841-1fc4-4cec-89bd-8f932270441a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.653s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:26:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Received event network-vif-plugged-c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:26:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] Acquiring lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:26:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] Lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:26:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] Lock "ac961841-1fc4-4cec-89bd-8f932270441a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:26:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] No waiting events found dispatching network-vif-plugged-c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:26:59 user nova-compute[82196]: WARNING nova.compute.manager [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Received unexpected event network-vif-plugged-c48d7fec-727d-409c-8285-6ae0da5ff14d for instance with vm_state deleted and task_state None.
Apr 11 19:26:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-eb4b3b6c-5e6d-4ca9-8b2c-c45450db5ed4 req-05849aa4-6677-42e9-b266-50acf1a3af38 service nova] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Received event network-vif-deleted-c48d7fec-727d-409c-8285-6ae0da5ff14d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "083108da-0a96-4177-8866-66131d77c39b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "083108da-0a96-4177-8866-66131d77c39b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "083108da-0a96-4177-8866-66131d77c39b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "083108da-0a96-4177-8866-66131d77c39b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "083108da-0a96-4177-8866-66131d77c39b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:02 user nova-compute[82196]: INFO nova.compute.manager [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Terminating instance
Apr 11 19:27:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-215c91ec-5986-48c1-94b6-d79c6d5b978b req-44e76cf8-9b80-4c18-82ed-cce22c60f89c service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Received event network-vif-unplugged-44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-215c91ec-5986-48c1-94b6-d79c6d5b978b req-44e76cf8-9b80-4c18-82ed-cce22c60f89c service nova] Acquiring lock "083108da-0a96-4177-8866-66131d77c39b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-215c91ec-5986-48c1-94b6-d79c6d5b978b req-44e76cf8-9b80-4c18-82ed-cce22c60f89c service nova] Lock "083108da-0a96-4177-8866-66131d77c39b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-215c91ec-5986-48c1-94b6-d79c6d5b978b req-44e76cf8-9b80-4c18-82ed-cce22c60f89c service nova] Lock "083108da-0a96-4177-8866-66131d77c39b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-215c91ec-5986-48c1-94b6-d79c6d5b978b req-44e76cf8-9b80-4c18-82ed-cce22c60f89c service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] No waiting events found dispatching network-vif-unplugged-44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-215c91ec-5986-48c1-94b6-d79c6d5b978b req-44e76cf8-9b80-4c18-82ed-cce22c60f89c service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Received event network-vif-unplugged-44671174-415b-41e7-964a-8c37ccb6a82d for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:03 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 083108da-0a96-4177-8866-66131d77c39b] Instance destroyed successfully.
Apr 11 19:27:03 user nova-compute[82196]: DEBUG nova.objects.instance [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lazy-loading 'resources' on Instance uuid 083108da-0a96-4177-8866-66131d77c39b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-522187297',display_name='tempest-VolumesAdminNegativeTest-server-522187297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-522187297',id=17,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:25:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f153e6b272924b8fa0ef28fb5f0970bb',ramdisk_id='',reservation_id='r-frdj9h73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1308264816',owner_user_name='tempest-VolumesAdminNegativeTest-1308264816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:25:18Z,user_data=None,user_id='54b4a383f04d4269a0099a738e14807e',uuid=083108da-0a96-4177-8866-66131d77c39b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44671174-415b-41e7-964a-8c37ccb6a82d", "address": "fa:16:3e:63:17:bc", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44671174-41", "ovs_interfaceid": "44671174-415b-41e7-964a-8c37ccb6a82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Converting VIF {"id": "44671174-415b-41e7-964a-8c37ccb6a82d", "address": "fa:16:3e:63:17:bc", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44671174-41", "ovs_interfaceid": "44671174-415b-41e7-964a-8c37ccb6a82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:17:bc,bridge_name='br-int',has_traffic_filtering=True,id=44671174-415b-41e7-964a-8c37ccb6a82d,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44671174-41') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG os_vif [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:17:bc,bridge_name='br-int',has_traffic_filtering=True,id=44671174-415b-41e7-964a-8c37ccb6a82d,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44671174-41') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44671174-41, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:03 user nova-compute[82196]: INFO os_vif [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:17:bc,bridge_name='br-int',has_traffic_filtering=True,id=44671174-415b-41e7-964a-8c37ccb6a82d,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44671174-41')
Apr 11 19:27:03 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Deleting instance files /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b_del
Apr 11 19:27:03 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Deletion of /opt/stack/data/nova/instances/083108da-0a96-4177-8866-66131d77c39b_del complete
Apr 11 19:27:03 user nova-compute[82196]: INFO nova.compute.manager [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 083108da-0a96-4177-8866-66131d77c39b] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 11 19:27:03 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 083108da-0a96-4177-8866-66131d77c39b] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 083108da-0a96-4177-8866-66131d77c39b] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241208.7624173, 6802f099-9236-4c79-a892-2963f1b15b0e => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:27:03 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] VM Stopped (Lifecycle Event)
Apr 11 19:27:03 user nova-compute[82196]: DEBUG nova.compute.manager [None req-537999a7-c949-4257-a7ac-e31a14c6ef6e None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG nova.compute.manager [None req-537999a7-c949-4257-a7ac-e31a14c6ef6e None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 083108da-0a96-4177-8866-66131d77c39b] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:27:03 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 083108da-0a96-4177-8866-66131d77c39b] Took 0.77 seconds to deallocate network for instance.
Apr 11 19:27:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:04 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:27:04 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:27:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:04 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Deleted allocations for instance 083108da-0a96-4177-8866-66131d77c39b
Apr 11 19:27:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d5236c76-7941-47f3-8f4b-91116e6b2feb tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "083108da-0a96-4177-8866-66131d77c39b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.958s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Received event network-vif-plugged-44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] Acquiring lock "083108da-0a96-4177-8866-66131d77c39b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] Lock "083108da-0a96-4177-8866-66131d77c39b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] Lock "083108da-0a96-4177-8866-66131d77c39b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] No waiting events found dispatching network-vif-plugged-44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:27:04 user nova-compute[82196]: WARNING nova.compute.manager [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Received unexpected event network-vif-plugged-44671174-415b-41e7-964a-8c37ccb6a82d for instance with vm_state deleted and task_state None.
Apr 11 19:27:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-25c60bd2-f764-4291-b6bf-ffc1c91f91e2 req-b616a371-5d2e-4004-9ccd-42642ddb5655 service nova] [instance: 083108da-0a96-4177-8866-66131d77c39b] Received event network-vif-deleted-44671174-415b-41e7-964a-8c37ccb6a82d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:12 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241217.898016, ac961841-1fc4-4cec-89bd-8f932270441a => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:27:12 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] VM Stopped (Lifecycle Event)
Apr 11 19:27:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bcbc1bc2-43fb-4521-861b-bbd02b88a5ef None None] [instance: ac961841-1fc4-4cec-89bd-8f932270441a] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:27:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:18 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241223.0102482, 083108da-0a96-4177-8866-66131d77c39b => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:27:18 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 083108da-0a96-4177-8866-66131d77c39b] VM Stopped (Lifecycle Event)
Apr 11 19:27:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-dfbd9fcf-459a-49eb-b456-af935b5a5acd None None] [instance: 083108da-0a96-4177-8866-66131d77c39b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:27:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:27:20 user nova-compute[82196]: INFO nova.compute.manager [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] instance snapshotting
Apr 11 19:27:20 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Beginning live snapshot process
Apr 11 19:27:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json -f qcow2 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json -f qcow2 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8fkga8rj/4a74f0dcb8454f95b8eaa3af36769312.delta 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8fkga8rj/4a74f0dcb8454f95b8eaa3af36769312.delta 1073741824" returned: 0 in 0.116s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:21 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 19:27:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:27:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:27:22 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 19:27:22 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:27:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8fkga8rj/4a74f0dcb8454f95b8eaa3af36769312.delta /opt/stack/data/nova/instances/snapshots/tmp8fkga8rj/4a74f0dcb8454f95b8eaa3af36769312 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8fkga8rj/4a74f0dcb8454f95b8eaa3af36769312.delta /opt/stack/data/nova/instances/snapshots/tmp8fkga8rj/4a74f0dcb8454f95b8eaa3af36769312" returned: 0 in 0.293s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:22 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Snapshot extracted, beginning image upload
Apr 11 19:27:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:23 user nova-compute[82196]: INFO nova.compute.manager [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Terminating instance
Apr 11 19:27:23 user nova-compute[82196]: DEBUG nova.compute.manager [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:27:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-292fdef8-86aa-41ac-b842-98fff12a32fb req-b75682f5-36be-430d-a1a7-75fdca04232a service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Received event network-vif-unplugged-b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-292fdef8-86aa-41ac-b842-98fff12a32fb req-b75682f5-36be-430d-a1a7-75fdca04232a service nova] Acquiring lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-292fdef8-86aa-41ac-b842-98fff12a32fb req-b75682f5-36be-430d-a1a7-75fdca04232a service nova] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-292fdef8-86aa-41ac-b842-98fff12a32fb req-b75682f5-36be-430d-a1a7-75fdca04232a service nova] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-292fdef8-86aa-41ac-b842-98fff12a32fb req-b75682f5-36be-430d-a1a7-75fdca04232a service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] No waiting events found dispatching network-vif-unplugged-b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-292fdef8-86aa-41ac-b842-98fff12a32fb req-b75682f5-36be-430d-a1a7-75fdca04232a service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Received event network-vif-unplugged-b644e09b-afb0-43e7-9773-0df435010320 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:27:24 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Instance destroyed successfully.
Apr 11 19:27:24 user nova-compute[82196]: DEBUG nova.objects.instance [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'resources' on Instance uuid bed4001c-02c2-4c6b-84c8-61654df66d8b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1923045055',display_name='tempest-AttachVolumeNegativeTest-server-1923045055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1923045055',id=3,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXl985Dnl44xCHtf4FIl1xYVxoZaplMJQzbwa3Y9N5KsJvliQVBgK4OaT/SgpGEh9Q8h4HPARqY2MPNwKL+8Ropi74fbtw+x6EYUP9DMyAquimJy9wP/Ns3xiePmd0rew==',key_name='tempest-keypair-253891769',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:21:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06966e2f4d3a4dec92282c7ad348635d',ramdisk_id='',reservation_id='r-xn9yuqzt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-303418642',owner_user_name='tempest-AttachVolumeNegativeTest-303418642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:21:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d405421ceb4d99967ef2e7f55e7809',uuid=bed4001c-02c2-4c6b-84c8-61654df66d8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b644e09b-afb0-43e7-9773-0df435010320", "address": "fa:16:3e:16:ad:8e", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb644e09b-af", "ovs_interfaceid": "b644e09b-afb0-43e7-9773-0df435010320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converting VIF {"id": "b644e09b-afb0-43e7-9773-0df435010320", "address": "fa:16:3e:16:ad:8e", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb644e09b-af", "ovs_interfaceid": "b644e09b-afb0-43e7-9773-0df435010320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:ad:8e,bridge_name='br-int',has_traffic_filtering=True,id=b644e09b-afb0-43e7-9773-0df435010320,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb644e09b-af') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG os_vif [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:ad:8e,bridge_name='br-int',has_traffic_filtering=True,id=b644e09b-afb0-43e7-9773-0df435010320,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb644e09b-af') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb644e09b-af, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:24 user nova-compute[82196]: INFO os_vif [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:ad:8e,bridge_name='br-int',has_traffic_filtering=True,id=b644e09b-afb0-43e7-9773-0df435010320,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb644e09b-af')
Apr 11 19:27:24 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Deleting instance files /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b_del
Apr 11 19:27:24 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Deletion of /opt/stack/data/nova/instances/bed4001c-02c2-4c6b-84c8-61654df66d8b_del complete
Apr 11 19:27:24 user nova-compute[82196]: INFO nova.compute.manager [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 11 19:27:24 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:27:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:25 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Snapshot image upload complete
Apr 11 19:27:25 user nova-compute[82196]: INFO nova.compute.manager [None req-37705614-fd1b-40c2-b99f-85de1f603de2 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Took 4.86 seconds to snapshot the instance on the hypervisor.
Apr 11 19:27:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:25 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:27:25 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Took 1.04 seconds to deallocate network for instance.
Apr 11 19:27:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-98ad3e04-703f-4859-8d3a-5ebcca954411 req-2c5553ba-947c-4690-b156-830741c638a0 service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Received event network-vif-deleted-b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:26 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:27:26 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:27:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:26 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Deleted allocations for instance bed4001c-02c2-4c6b-84c8-61654df66d8b
Apr 11 19:27:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5b5966a2-afa4-4f4d-9e85-d2605bbc962d tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.500s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-662e57c7-789f-43d6-9b89-31df5ac8b2f9 req-1b920703-4165-4803-90d5-f2ba69178bd7 service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Received event network-vif-plugged-b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-662e57c7-789f-43d6-9b89-31df5ac8b2f9 req-1b920703-4165-4803-90d5-f2ba69178bd7 service nova] Acquiring lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-662e57c7-789f-43d6-9b89-31df5ac8b2f9 req-1b920703-4165-4803-90d5-f2ba69178bd7 service nova] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-662e57c7-789f-43d6-9b89-31df5ac8b2f9 req-1b920703-4165-4803-90d5-f2ba69178bd7 service nova] Lock "bed4001c-02c2-4c6b-84c8-61654df66d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-662e57c7-789f-43d6-9b89-31df5ac8b2f9 req-1b920703-4165-4803-90d5-f2ba69178bd7 service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] No waiting events found dispatching network-vif-plugged-b644e09b-afb0-43e7-9773-0df435010320 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:27:26 user nova-compute[82196]: WARNING nova.compute.manager [req-662e57c7-789f-43d6-9b89-31df5ac8b2f9 req-1b920703-4165-4803-90d5-f2ba69178bd7 service nova] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Received unexpected event network-vif-plugged-b644e09b-afb0-43e7-9773-0df435010320 for instance with vm_state deleted and task_state None.
Apr 11 19:27:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:32 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:34 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:34 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:34 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:34 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82196) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 19:27:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:27:35 user nova-compute[82196]: INFO nova.compute.manager [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Unrescuing
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquired lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG nova.network.neutron [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG nova.network.neutron [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updating instance_info_cache with network_info: [{"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Releasing lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'flavor' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-5d835bf7-7305-4e11-9ed2-5a851bfb0904 req-27c57c7e-5b1c-4a4f-adf7-16a5ced449ce service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-unplugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5d835bf7-7305-4e11-9ed2-5a851bfb0904 req-27c57c7e-5b1c-4a4f-adf7-16a5ced449ce service nova] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5d835bf7-7305-4e11-9ed2-5a851bfb0904 req-27c57c7e-5b1c-4a4f-adf7-16a5ced449ce service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5d835bf7-7305-4e11-9ed2-5a851bfb0904 req-27c57c7e-5b1c-4a4f-adf7-16a5ced449ce service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-5d835bf7-7305-4e11-9ed2-5a851bfb0904 req-27c57c7e-5b1c-4a4f-adf7-16a5ced449ce service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] No waiting events found dispatching network-vif-unplugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:27:36 user nova-compute[82196]: WARNING nova.compute.manager [req-5d835bf7-7305-4e11-9ed2-5a851bfb0904 req-27c57c7e-5b1c-4a4f-adf7-16a5ced449ce service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received unexpected event network-vif-unplugged-5a15e207-1839-4be5-80b2-fc995098dbbf for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-changed-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Refreshing instance network info cache due to event network-changed-5a15e207-1839-4be5-80b2-fc995098dbbf. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] Acquiring lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] Acquired lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG nova.network.neutron [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Refreshing network info cache for port 5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:36 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Instance destroyed successfully.
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG nova.network.neutron [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updated VIF entry in instance network info cache for port 5a15e207-1839-4be5-80b2-fc995098dbbf. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG nova.network.neutron [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updating instance_info_cache with network_info: [{"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:27:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dafb895a-542f-4370-a7a9-a3b12c6473a3 req-d061381d-c11e-4e30-86d4-58d2f0e05bae service nova] Releasing lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:27:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] No waiting events found dispatching network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:27:38 user nova-compute[82196]: WARNING nova.compute.manager [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received unexpected event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:27:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] No waiting events found dispatching network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:27:38 user nova-compute[82196]: WARNING nova.compute.manager [req-3d081d79-5197-4f1b-9b6a-2af5f73addcc req-cff2c0fa-f3db-443c-b681-8fe62b4c82a1 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received unexpected event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-changed-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Refreshing instance network info cache due to event network-changed-5a15e207-1839-4be5-80b2-fc995098dbbf. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] Acquiring lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] Acquired lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG nova.network.neutron [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Refreshing network info cache for port 5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG nova.network.neutron [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updated VIF entry in instance network info cache for port 5a15e207-1839-4be5-80b2-fc995098dbbf. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG nova.network.neutron [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updating instance_info_cache with network_info: [{"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-543751fc-8e13-4b87-bc0c-bdd7e90d09a3 req-2dcabc12-9e88-4412-b31d-9e132838a108 service nova] Releasing lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241244.6232326, bed4001c-02c2-4c6b-84c8-61654df66d8b => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:27:39 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] VM Stopped (Lifecycle Event)
Apr 11 19:27:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bbd60941-7229-4436-b1d2-ed003d43b402 None None] [instance: bed4001c-02c2-4c6b-84c8-61654df66d8b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for aa0bb9aa-a93d-45bc-9f90-46eeb6416365 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241260.0735726, aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:27:40 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] VM Resumed (Lifecycle Event)
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-0ce44d55-c426-4dbc-a66b-f0acf9e1bd77 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:27:40 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:27:40 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7679MB free_disk=26.317630767822266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.manager [req-309a51c0-77af-485f-9f08-97b169757f5e req-ec78f223-bbe5-41c7-9e62-e9f59d54bd1e service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-309a51c0-77af-485f-9f08-97b169757f5e req-ec78f223-bbe5-41c7-9e62-e9f59d54bd1e service nova] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-309a51c0-77af-485f-9f08-97b169757f5e req-ec78f223-bbe5-41c7-9e62-e9f59d54bd1e service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-309a51c0-77af-485f-9f08-97b169757f5e req-ec78f223-bbe5-41c7-9e62-e9f59d54bd1e service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.manager [req-309a51c0-77af-485f-9f08-97b169757f5e req-ec78f223-bbe5-41c7-9e62-e9f59d54bd1e service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] No waiting events found dispatching network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:27:40 user nova-compute[82196]: WARNING nova.compute.manager [req-309a51c0-77af-485f-9f08-97b169757f5e req-ec78f223-bbe5-41c7-9e62-e9f59d54bd1e service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received unexpected event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:27:40 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241260.074642, aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:27:40 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] VM Started (Lifecycle Event)
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9941d033-15c2-4069-b9a6-f80840e95a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6802f099-9236-4c79-a892-2963f1b15b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 720c683f-c03a-444c-92a8-daf97c9f524b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing inventories for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Updating ProviderTree inventory for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Updating inventory in ProviderTree for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing aggregate associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, aggregates: None {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing trait associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 19:27:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] There are 0 instances to clean {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 19:27:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:27:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:27:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:27:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:27:42 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:27:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:27:42 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Updating instance_info_cache with network_info: [{"id": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "address": "fa:16:3e:c2:7d:b5", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4beb6cf-d1", "ovs_interfaceid": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:27:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:27:42 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:27:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:27:42 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:27:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG nova.compute.manager [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Received event network-changed-77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG nova.compute.manager [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Refreshing instance network info cache due to event network-changed-77bd0f58-75d0-4cc3-ab98-4f4b31401482. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] Acquiring lock "refresh_cache-f37ed08c-8c9a-4af7-ba5f-b8a942e54389" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] Acquired lock "refresh_cache-f37ed08c-8c9a-4af7-ba5f-b8a942e54389" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Refreshing network info cache for port 77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG nova.objects.instance [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'flavor' on Instance uuid f37ed08c-8c9a-4af7-ba5f-b8a942e54389 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:47 user nova-compute[82196]: INFO nova.compute.manager [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Attaching volume a8c38948-98ba-4df2-9662-251d3da4b5d7 to /dev/vdb
Apr 11 19:27:47 user nova-compute[82196]: DEBUG os_brick.utils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Updated VIF entry in instance network info cache for port 77bd0f58-75d0-4cc3-ab98-4f4b31401482. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Updating instance_info_cache with network_info: [{"id": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "address": "fa:16:3e:7e:08:f3", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77bd0f58-75", "ovs_interfaceid": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db011ab-1f02-410c-bfc7-1ffb93a50974]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95c1da2e-8573-414b-a7a5-7af30c19eaf7 req-68ea6365-7d64-461a-bfb9-ef4922ea7579 service nova] Releasing lock "refresh_cache-f37ed08c-8c9a-4af7-ba5f-b8a942e54389" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[735a3a41-dba0-43ee-9d14-10ec0ad5e7d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d143b15-04f3-4f4f-be39-3c8d2f0e5258]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4942d05-4be7-41ff-9773-01f24d156a3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:27:48 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:27:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd880eb-75b8-440f-bced-fdea06540e01]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG os_brick.utils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:27:48 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Updating existing volume attachment record: ba3ff586-521a-4940-adf3-4d254a9e97b0 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:27:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rZTlvoFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:27:52 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:27:52 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:27:52 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de978dd-aa8a-432f-9fa8-b34bb04d60db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:27:52 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c850d30-ef7b-4d82-9939-a858ed024db0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7] added
Apr 11 19:27:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[140a0eb0-1094-4f83-bc6b-c80f596da2b0]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fccf70d-8455-40f1-bb63-26d7f1afce65]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rZTlvoFk {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rZTlvoFk" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7488c42-2ddb-4a7e-a820-952b8e3954ca]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rZTlvoFk'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fceaafe-b9f2-4f4b-a4aa-c83c390d9d7c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b704891-2ad6-42c1-a580-4ee1f360d76b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:27:52 user nova-compute[82196]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:27:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:27:52 user nova-compute[82196]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:27:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c411e016-5325-4ffb-947b-553ac0d38c25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7, portal: 172.16.0.220,3260]
Apr 11 19:27:52 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7, portal: 172.16.0.220,3260] successful.
Apr 11 19:27:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6f6caa-6c81-40a3-bbd3-3d8143aa0585]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:53 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ea6ac1-5b15-4274-b5d9-c3b8e237972d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:27:53 user nova-compute[82196]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:27:53 user nova-compute[82196]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 (non-flash)
Apr 11 19:27:53 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:27:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:27:53 user nova-compute[82196]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:27:53 user nova-compute[82196]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 (non-flash)
Apr 11 19:27:53 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:27:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:27:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:27:53 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:27:53 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:27:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:53 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2645a9f4-e3ee-45b6-912b-3f92100c967d]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:53 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: None {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rZTlvoFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23464323665333536', 'path': '/dev/sdd'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464323665333536', 'path': '/dev/sdd'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.objects.instance [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'flavor' on Instance uuid f37ed08c-8c9a-4af7-ba5f-b8a942e54389 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:27:54 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:27:54 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:27:54 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:27:54 user nova-compute[82196]:   <serial>a8c38948-98ba-4df2-9662-251d3da4b5d7</serial>
Apr 11 19:27:54 user nova-compute[82196]: </disk>
Apr 11 19:27:54 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "9941d033-15c2-4069-b9a6-f80840e95a38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "9941d033-15c2-4069-b9a6-f80840e95a38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:54 user nova-compute[82196]: INFO nova.compute.manager [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Terminating instance
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-6dce3ff4-a470-49fd-8934-64a34f845ab5 req-efefed41-ea96-46a4-b350-8c1bd424b414 service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Received event network-vif-unplugged-031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6dce3ff4-a470-49fd-8934-64a34f845ab5 req-efefed41-ea96-46a4-b350-8c1bd424b414 service nova] Acquiring lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6dce3ff4-a470-49fd-8934-64a34f845ab5 req-efefed41-ea96-46a4-b350-8c1bd424b414 service nova] Lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6dce3ff4-a470-49fd-8934-64a34f845ab5 req-efefed41-ea96-46a4-b350-8c1bd424b414 service nova] Lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-6dce3ff4-a470-49fd-8934-64a34f845ab5 req-efefed41-ea96-46a4-b350-8c1bd424b414 service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] No waiting events found dispatching network-vif-unplugged-031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-6dce3ff4-a470-49fd-8934-64a34f845ab5 req-efefed41-ea96-46a4-b350-8c1bd424b414 service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Received event network-vif-unplugged-031df3cc-5433-459d-ab9b-484629289e90 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] No VIF found with MAC fa:16:3e:7e:08:f3, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:27:54 user nova-compute[82196]: INFO nova.compute.manager [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Detaching volume f2d4810b-a6fe-4903-813a-a0562018f061
Apr 11 19:27:54 user nova-compute[82196]: INFO nova.virt.block_device [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Attempting to driver detach volume f2d4810b-a6fe-4903-813a-a0562018f061 from mountpoint /dev/vdb
Apr 11 19:27:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Attempting to detach device vdb from instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:27:54 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:27:54 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:27:54 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:27:54 user nova-compute[82196]:   <serial>f2d4810b-a6fe-4903-813a-a0562018f061</serial>
Apr 11 19:27:54 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:27:54 user nova-compute[82196]: </disk>
Apr 11 19:27:54 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:27:54 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Successfully detached device vdb from instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 from the persistent domain config.
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:27:54 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:27:54 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:27:54 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:27:54 user nova-compute[82196]:   <serial>f2d4810b-a6fe-4903-813a-a0562018f061</serial>
Apr 11 19:27:54 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:27:54 user nova-compute[82196]: </disk>
Apr 11 19:27:54 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:27:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-838ebb3c-83f9-4818-bdb0-4764d11e2a5f tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.842s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241275.1811635, aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:27:55 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Successfully detached device vdb from instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 from the live domain config.
Apr 11 19:27:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTNDBvjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:27:55 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:55 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Instance destroyed successfully.
Apr 11 19:27:55 user nova-compute[82196]: DEBUG nova.objects.instance [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lazy-loading 'resources' on Instance uuid 9941d033-15c2-4069-b9a6-f80840e95a38 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:22:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-998535947',display_name='tempest-VolumesAdminNegativeTest-server-998535947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-998535947',id=7,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODsmyLx9btIMCYnKduEXVz7JAuk7UhzzERb5FI4FKe+6s/Du4EGpizaOPcFRAe03vOmbzTlXTZKfjibJnH2fbJO2ZanWvJcEb81dDY4qGyrsZxZsx7z4jkiSNbg+OQg3w==',key_name='tempest-keypair-837441637',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f153e6b272924b8fa0ef28fb5f0970bb',ramdisk_id='',reservation_id='r-b8rbzc5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1308264816',owner_user_name='tempest-VolumesAdminNegativeTest-1308264816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b4a383f04d4269a0099a738e14807e',uuid=9941d033-15c2-4069-b9a6-f80840e95a38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "031df3cc-5433-459d-ab9b-484629289e90", "address": "fa:16:3e:b6:4d:98", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031df3cc-54", "ovs_interfaceid": "031df3cc-5433-459d-ab9b-484629289e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Converting VIF {"id": "031df3cc-5433-459d-ab9b-484629289e90", "address": "fa:16:3e:b6:4d:98", "network": {"id": "c4faff63-06aa-4a91-8681-e5d654e5da93", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89072845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f153e6b272924b8fa0ef28fb5f0970bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031df3cc-54", "ovs_interfaceid": "031df3cc-5433-459d-ab9b-484629289e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:4d:98,bridge_name='br-int',has_traffic_filtering=True,id=031df3cc-5433-459d-ab9b-484629289e90,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031df3cc-54') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_vif [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:4d:98,bridge_name='br-int',has_traffic_filtering=True,id=031df3cc-5433-459d-ab9b-484629289e90,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031df3cc-54') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[456a5bba-cf85-474c-9e92-bffd7006dc31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0019d6a7-d7f6-40c0-9a35-09686ca7c9e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:27:55 user nova-compute[82196]: No targets found.
Apr 11 19:27:55 user nova-compute[82196]: iSNS:
Apr 11 19:27:55 user nova-compute[82196]: No targets found.
Apr 11 19:27:55 user nova-compute[82196]: STATIC:
Apr 11 19:27:55 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7
Apr 11 19:27:55 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:27:55 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:27:55 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e
Apr 11 19:27:55 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:27:55 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:27:55 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:0019d6a7-d7f6-40c0-9a35-09686ca7c9e0
Apr 11 19:27:55 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:27:55 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:27:55 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061
Apr 11 19:27:55 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:27:55 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:27:55 user nova-compute[82196]: FIRMWARE:
Apr 11 19:27:55 user nova-compute[82196]: No targets found.
Apr 11 19:27:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:27:55 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:27:55 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap031df3cc-54, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:27:55 user nova-compute[82196]: INFO os_vif [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:4d:98,bridge_name='br-int',has_traffic_filtering=True,id=031df3cc-5433-459d-ab9b-484629289e90,network=Network(c4faff63-06aa-4a91-8681-e5d654e5da93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031df3cc-54')
Apr 11 19:27:55 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Deleting instance files /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38_del
Apr 11 19:27:55 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Deletion of /opt/stack/data/nova/instances/9941d033-15c2-4069-b9a6-f80840e95a38_del complete
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce08a06e-68a1-4ef5-bf0e-c5401ca5f716]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0019d6a7-d7f6-40c0-9a35-09686ca7c9e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[356fbdbc-b598-4d94-abae-3f94a68c52f7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019d6a7-d7f6-40c0-9a35-09686ca7c9e0 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:27:55 user nova-compute[82196]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:27:55 user nova-compute[82196]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 (non-flash)
Apr 11 19:27:55 user nova-compute[82196]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019d6a7-d7f6-40c0-9a35-09686ca7c9e0 (non-flash)
Apr 11 19:27:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 (non-flash)
Apr 11 19:27:55 user nova-compute[82196]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:27:55 user nova-compute[82196]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 (non-flash)
Apr 11 19:27:55 user nova-compute[82196]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019d6a7-d7f6-40c0-9a35-09686ca7c9e0 (non-flash)
Apr 11 19:27:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9281a2e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061'): ({'sdb'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Removing single pathed devices sdb {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1fe620-63b0-4f60-975f-c882d1b57b2a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:55 user nova-compute[82196]: INFO nova.compute.manager [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f685c4-f3ad-4aff-a0cb-169400eefc35]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Flushing IO for device /dev/sdb {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bc17c8-e475-4c27-b0c7-4afe7cd41a99]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0748b8c8-9664-4ac7-b226-08a8e322655a]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1388569-e8e2-4fc3-8514-9de65f5ca582]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[371c53b5-46e6-4f41-b546-9389c78fde3c]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061, portal: 172.16.0.220,3260]
Apr 11 19:27:55 user nova-compute[82196]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061, portal: 172.16.0.220,3260] successful.
Apr 11 19:27:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d4810b-a6fe-4903-813a-a0562018f061 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2913137-f21d-4625-ab46-0ad2f3774963]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] <== disconnect_volume: return (345ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:27:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:56 user nova-compute[82196]: INFO nova.compute.manager [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Detaching volume a8c38948-98ba-4df2-9662-251d3da4b5d7
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:27:56 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Took 0.77 seconds to deallocate network for instance.
Apr 11 19:27:56 user nova-compute[82196]: INFO nova.virt.block_device [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Attempting to driver detach volume a8c38948-98ba-4df2-9662-251d3da4b5d7 from mountpoint /dev/vdb
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Attempting to detach device vdb from instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:27:56 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:27:56 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:27:56 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:27:56 user nova-compute[82196]:   <serial>a8c38948-98ba-4df2-9662-251d3da4b5d7</serial>
Apr 11 19:27:56 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:27:56 user nova-compute[82196]: </disk>
Apr 11 19:27:56 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:27:56 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Successfully detached device vdb from instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 from the persistent domain config.
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:27:56 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:27:56 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:27:56 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:27:56 user nova-compute[82196]:   <serial>a8c38948-98ba-4df2-9662-251d3da4b5d7</serial>
Apr 11 19:27:56 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:27:56 user nova-compute[82196]: </disk>
Apr 11 19:27:56 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:56 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Deleted allocations for instance 9941d033-15c2-4069-b9a6-f80840e95a38
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'flavor' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Received event network-vif-plugged-031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] Acquiring lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] Lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] Lock "9941d033-15c2-4069-b9a6-f80840e95a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] No waiting events found dispatching network-vif-plugged-031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:27:56 user nova-compute[82196]: WARNING nova.compute.manager [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Received unexpected event network-vif-plugged-031df3cc-5433-459d-ab9b-484629289e90 for instance with vm_state deleted and task_state None.
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-f6346558-317e-44c0-9a3e-5f80bd6414f9 req-eb00d792-0648-4cb6-9a69-29a0ad4d0e4d service nova] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Received event network-vif-deleted-031df3cc-5433-459d-ab9b-484629289e90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241276.5656452, f37ed08c-8c9a-4af7-ba5f-b8a942e54389 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:27:56 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Successfully detached device vdb from instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 from the live domain config.
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rZTlvoFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:27:56 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ca03b349-3443-4041-b108-6a738641c832 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.048s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8e4416-aa2d-4c89-a655-47ea86c98cf8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0019d6a7-d7f6-40c0-9a35-09686ca7c9e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:27:56 user nova-compute[82196]: No targets found.
Apr 11 19:27:56 user nova-compute[82196]: iSNS:
Apr 11 19:27:56 user nova-compute[82196]: No targets found.
Apr 11 19:27:56 user nova-compute[82196]: STATIC:
Apr 11 19:27:56 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7
Apr 11 19:27:56 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:27:56 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:27:56 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e
Apr 11 19:27:56 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:27:56 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:27:56 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:0019d6a7-d7f6-40c0-9a35-09686ca7c9e0
Apr 11 19:27:56 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:27:56 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:27:56 user nova-compute[82196]: FIRMWARE:
Apr 11 19:27:56 user nova-compute[82196]: No targets found.
Apr 11 19:27:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:27:56 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:27:56 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dd8fe315-9f88-4e98-b980-9ed045be584c tempest-VolumesAdminNegativeTest-1308264816 tempest-VolumesAdminNegativeTest-1308264816-project-member] Lock "9941d033-15c2-4069-b9a6-f80840e95a38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.456s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb0c474-ccb5-4e02-b354-7691111a0e9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0019d6a7-d7f6-40c0-9a35-09686ca7c9e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe4b730-4764-48d6-9ef9-b69b2db2a842]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019d6a7-d7f6-40c0-9a35-09686ca7c9e0 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:27:56 user nova-compute[82196]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 (non-flash)
Apr 11 19:27:56 user nova-compute[82196]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019d6a7-d7f6-40c0-9a35-09686ca7c9e0 (non-flash)
Apr 11 19:27:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:27:56 user nova-compute[82196]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 (non-flash)
Apr 11 19:27:56 user nova-compute[82196]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019d6a7-d7f6-40c0-9a35-09686ca7c9e0 (non-flash)
Apr 11 19:27:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f924073b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7'): ({'sdd'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Removing single pathed devices sdd {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a420147d-9f7d-4e31-8544-d70b46eee795]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2827028a-f8c0-45dd-b443-e2dbc0048d1d]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Flushing IO for device /dev/sdd {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cb3b21-735a-4ddc-bbb7-6ee2ad1c9bc4]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c319ca-9191-4977-b8d9-781174dff3f8]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46d9ff0-c88e-43ea-bb2c-7799af21f300]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8628831-d4ba-41ad-a125-b942c008b420]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7, portal: 172.16.0.220,3260]
Apr 11 19:27:56 user nova-compute[82196]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7, portal: 172.16.0.220,3260] successful.
Apr 11 19:27:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c38948-98ba-4df2-9662-251d3da4b5d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c6f68d-a8ef-46f6-9e16-1dd771a157bc]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] <== disconnect_volume: return (282ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:27:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:27:57 user nova-compute[82196]: DEBUG nova.objects.instance [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'flavor' on Instance uuid f37ed08c-8c9a-4af7-ba5f-b8a942e54389 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:27:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-13fe69ae-a917-4fc1-9956-997b881ff4a5 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.865s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:27:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid d424f88d-5f82-4cac-aa0f-4f99624bd3e7 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid f37ed08c-8c9a-4af7-ba5f-b8a942e54389 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "720c683f-c03a-444c-92a8-daf97c9f524b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "647674d8-af53-405a-8116-4b7a01549bdf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "647674d8-af53-405a-8116-4b7a01549bdf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "720c683f-c03a-444c-92a8-daf97c9f524b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:10 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241275.1947956, 9941d033-15c2-4069-b9a6-f80840e95a38 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:28:10 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] VM Stopped (Lifecycle Event)
Apr 11 19:28:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ff2b863e-7a9b-4e7a-9805-997a71b6c335 None None] [instance: 9941d033-15c2-4069-b9a6-f80840e95a38] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:28:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "558100b9-f3ac-47c7-9260-b897b0cae55f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:17 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:28:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:17 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:28:17 user nova-compute[82196]: INFO nova.compute.claims [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Claim successful on node user
Apr 11 19:28:18 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:28:18 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:28:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG nova.policy [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:28:18 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Creating image(s)
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "/opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "/opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "/opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.179s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk 1073741824" returned: 0 in 0.054s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:28:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Successfully created port: 4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Cannot resize image /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'migration_context' on Instance uuid 558100b9-f3ac-47c7-9260-b897b0cae55f {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Ensure instance console log exists: /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Successfully updated port: 4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "refresh_cache-558100b9-f3ac-47c7-9260-b897b0cae55f" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquired lock "refresh_cache-558100b9-f3ac-47c7-9260-b897b0cae55f" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG nova.compute.manager [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received event network-changed-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG nova.compute.manager [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Refreshing instance network info cache due to event network-changed-4f568bd5-7271-434e-a30e-beb13759e1f1. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] Acquiring lock "refresh_cache-558100b9-f3ac-47c7-9260-b897b0cae55f" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:28:19 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Updating instance_info_cache with network_info: [{"id": "4f568bd5-7271-434e-a30e-beb13759e1f1", "address": "fa:16:3e:93:57:af", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f568bd5-72", "ovs_interfaceid": "4f568bd5-7271-434e-a30e-beb13759e1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Releasing lock "refresh_cache-558100b9-f3ac-47c7-9260-b897b0cae55f" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Instance network_info: |[{"id": "4f568bd5-7271-434e-a30e-beb13759e1f1", "address": "fa:16:3e:93:57:af", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f568bd5-72", "ovs_interfaceid": "4f568bd5-7271-434e-a30e-beb13759e1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] Acquired lock "refresh_cache-558100b9-f3ac-47c7-9260-b897b0cae55f" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.network.neutron [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Refreshing network info cache for port 4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Start _get_guest_xml network_info=[{"id": "4f568bd5-7271-434e-a30e-beb13759e1f1", "address": "fa:16:3e:93:57:af", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f568bd5-72", "ovs_interfaceid": "4f568bd5-7271-434e-a30e-beb13759e1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:28:20 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:28:20 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-685848689',display_name='tempest-AttachVolumeNegativeTest-server-685848689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-685848689',id=22,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0gNEuZy4WwlntDCrxaO0By8v6wh2LPSvcUjVDg7AoB9duP6CtOuqC+mGfVgzWe8DlNEj6aUlezeF0+IV6nwjLFlAzfgxa89U94DyhZnjYMUBWl9xaaflLwBRbhfRP9Mg==',key_name='tempest-keypair-1056959304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06966e2f4d3a4dec92282c7ad348635d',ramdisk_id='',reservation_id='r-93najogc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-303418642',owner_user_name='tempest-AttachVolumeNegativeTest-303418642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:28:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d405421ceb4d99967ef2e7f55e7809',uuid=558100b9-f3ac-47c7-9260-b897b0cae55f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f568bd5-7271-434e-a30e-beb13759e1f1", "address": "fa:16:3e:93:57:af", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f568bd5-72", "ovs_interfaceid": "4f568bd5-7271-434e-a30e-beb13759e1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converting VIF {"id": "4f568bd5-7271-434e-a30e-beb13759e1f1", "address": "fa:16:3e:93:57:af", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f568bd5-72", "ovs_interfaceid": "4f568bd5-7271-434e-a30e-beb13759e1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:57:af,bridge_name='br-int',has_traffic_filtering=True,id=4f568bd5-7271-434e-a30e-beb13759e1f1,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f568bd5-72') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'pci_devices' on Instance uuid 558100b9-f3ac-47c7-9260-b897b0cae55f {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:28:20 user nova-compute[82196]:   <uuid>558100b9-f3ac-47c7-9260-b897b0cae55f</uuid>
Apr 11 19:28:20 user nova-compute[82196]:   <name>instance-00000016</name>
Apr 11 19:28:20 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:28:20 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:28:20 user nova-compute[82196]:   <metadata>
Apr 11 19:28:20 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:28:20 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:28:20 user nova-compute[82196]:       <nova:name>tempest-AttachVolumeNegativeTest-server-685848689</nova:name>
Apr 11 19:28:20 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:28:20</nova:creationTime>
Apr 11 19:28:20 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:28:20 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:28:20 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:28:20 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:28:20 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:28:20 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:28:20 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:28:20 user nova-compute[82196]:       <nova:owner>
Apr 11 19:28:20 user nova-compute[82196]:         <nova:user uuid="d5d405421ceb4d99967ef2e7f55e7809">tempest-AttachVolumeNegativeTest-303418642-project-member</nova:user>
Apr 11 19:28:20 user nova-compute[82196]:         <nova:project uuid="06966e2f4d3a4dec92282c7ad348635d">tempest-AttachVolumeNegativeTest-303418642</nova:project>
Apr 11 19:28:20 user nova-compute[82196]:       </nova:owner>
Apr 11 19:28:20 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:28:20 user nova-compute[82196]:       <nova:ports>
Apr 11 19:28:20 user nova-compute[82196]:         <nova:port uuid="4f568bd5-7271-434e-a30e-beb13759e1f1">
Apr 11 19:28:20 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 19:28:20 user nova-compute[82196]:         </nova:port>
Apr 11 19:28:20 user nova-compute[82196]:       </nova:ports>
Apr 11 19:28:20 user nova-compute[82196]:     </nova:instance>
Apr 11 19:28:20 user nova-compute[82196]:   </metadata>
Apr 11 19:28:20 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:28:20 user nova-compute[82196]:     <system>
Apr 11 19:28:20 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:28:20 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:28:20 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:28:20 user nova-compute[82196]:       <entry name="serial">558100b9-f3ac-47c7-9260-b897b0cae55f</entry>
Apr 11 19:28:20 user nova-compute[82196]:       <entry name="uuid">558100b9-f3ac-47c7-9260-b897b0cae55f</entry>
Apr 11 19:28:20 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:28:20 user nova-compute[82196]:     </system>
Apr 11 19:28:20 user nova-compute[82196]:   </sysinfo>
Apr 11 19:28:20 user nova-compute[82196]:   <os>
Apr 11 19:28:20 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:28:20 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:28:20 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:28:20 user nova-compute[82196]:   </os>
Apr 11 19:28:20 user nova-compute[82196]:   <features>
Apr 11 19:28:20 user nova-compute[82196]:     <acpi/>
Apr 11 19:28:20 user nova-compute[82196]:     <apic/>
Apr 11 19:28:20 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:28:20 user nova-compute[82196]:   </features>
Apr 11 19:28:20 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:28:20 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:28:20 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:28:20 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:28:20 user nova-compute[82196]:   </clock>
Apr 11 19:28:20 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:28:20 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:28:20 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:28:20 user nova-compute[82196]:   </cpu>
Apr 11 19:28:20 user nova-compute[82196]:   <devices>
Apr 11 19:28:20 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:28:20 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:28:20 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk"/>
Apr 11 19:28:20 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:28:20 user nova-compute[82196]:     </disk>
Apr 11 19:28:20 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:28:20 user nova-compute[82196]:       <mac address="fa:16:3e:93:57:af"/>
Apr 11 19:28:20 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:28:20 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:28:20 user nova-compute[82196]:       <target dev="tap4f568bd5-72"/>
Apr 11 19:28:20 user nova-compute[82196]:     </interface>
Apr 11 19:28:20 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:28:20 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/console.log" append="off"/>
Apr 11 19:28:20 user nova-compute[82196]:     </serial>
Apr 11 19:28:20 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:28:20 user nova-compute[82196]:     <video>
Apr 11 19:28:20 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:28:20 user nova-compute[82196]:     </video>
Apr 11 19:28:20 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:28:20 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:28:20 user nova-compute[82196]:     </rng>
Apr 11 19:28:20 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:28:20 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:28:20 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:28:20 user nova-compute[82196]:     </memballoon>
Apr 11 19:28:20 user nova-compute[82196]:   </devices>
Apr 11 19:28:20 user nova-compute[82196]: </domain>
Apr 11 19:28:20 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-685848689',display_name='tempest-AttachVolumeNegativeTest-server-685848689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-685848689',id=22,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0gNEuZy4WwlntDCrxaO0By8v6wh2LPSvcUjVDg7AoB9duP6CtOuqC+mGfVgzWe8DlNEj6aUlezeF0+IV6nwjLFlAzfgxa89U94DyhZnjYMUBWl9xaaflLwBRbhfRP9Mg==',key_name='tempest-keypair-1056959304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06966e2f4d3a4dec92282c7ad348635d',ramdisk_id='',reservation_id='r-93najogc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-303418642',owner_user_name='tempest-AttachVolumeNegativeTest-303418642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:28:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d405421ceb4d99967ef2e7f55e7809',uuid=558100b9-f3ac-47c7-9260-b897b0cae55f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f568bd5-7271-434e-a30e-beb13759e1f1", "address": "fa:16:3e:93:57:af", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f568bd5-72", "ovs_interfaceid": "4f568bd5-7271-434e-a30e-beb13759e1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converting VIF {"id": "4f568bd5-7271-434e-a30e-beb13759e1f1", "address": "fa:16:3e:93:57:af", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f568bd5-72", "ovs_interfaceid": "4f568bd5-7271-434e-a30e-beb13759e1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:57:af,bridge_name='br-int',has_traffic_filtering=True,id=4f568bd5-7271-434e-a30e-beb13759e1f1,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f568bd5-72') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG os_vif [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:57:af,bridge_name='br-int',has_traffic_filtering=True,id=4f568bd5-7271-434e-a30e-beb13759e1f1,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f568bd5-72') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f568bd5-72, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f568bd5-72, col_values=(('external_ids', {'iface-id': '4f568bd5-7271-434e-a30e-beb13759e1f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:57:af', 'vm-uuid': '558100b9-f3ac-47c7-9260-b897b0cae55f'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:20 user nova-compute[82196]: INFO os_vif [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:57:af,bridge_name='br-int',has_traffic_filtering=True,id=4f568bd5-7271-434e-a30e-beb13759e1f1,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f568bd5-72')
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No VIF found with MAC fa:16:3e:93:57:af, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.network.neutron [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Updated VIF entry in instance network info cache for port 4f568bd5-7271-434e-a30e-beb13759e1f1. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG nova.network.neutron [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Updating instance_info_cache with network_info: [{"id": "4f568bd5-7271-434e-a30e-beb13759e1f1", "address": "fa:16:3e:93:57:af", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f568bd5-72", "ovs_interfaceid": "4f568bd5-7271-434e-a30e-beb13759e1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d4a1046f-cb3f-4000-87fd-862a1d720a20 req-c2d016ee-b57d-4973-a0bb-390f02b9bc31 service nova] Releasing lock "refresh_cache-558100b9-f3ac-47c7-9260-b897b0cae55f" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:28:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-dfed92c9-ce3c-45f1-9c2f-129dffad2cf7 req-fd7efe52-8180-4803-a168-5c91007e50c0 service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received event network-vif-plugged-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfed92c9-ce3c-45f1-9c2f-129dffad2cf7 req-fd7efe52-8180-4803-a168-5c91007e50c0 service nova] Acquiring lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfed92c9-ce3c-45f1-9c2f-129dffad2cf7 req-fd7efe52-8180-4803-a168-5c91007e50c0 service nova] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-dfed92c9-ce3c-45f1-9c2f-129dffad2cf7 req-fd7efe52-8180-4803-a168-5c91007e50c0 service nova] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-dfed92c9-ce3c-45f1-9c2f-129dffad2cf7 req-fd7efe52-8180-4803-a168-5c91007e50c0 service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] No waiting events found dispatching network-vif-plugged-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:28:21 user nova-compute[82196]: WARNING nova.compute.manager [req-dfed92c9-ce3c-45f1-9c2f-129dffad2cf7 req-fd7efe52-8180-4803-a168-5c91007e50c0 service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received unexpected event network-vif-plugged-4f568bd5-7271-434e-a30e-beb13759e1f1 for instance with vm_state building and task_state spawning.
Apr 11 19:28:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241304.0375898, 558100b9-f3ac-47c7-9260-b897b0cae55f => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:28:24 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] VM Resumed (Lifecycle Event)
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-9ca316e5-75bb-4031-b770-cd7b2a3c5554 req-dece3f83-fa7b-43d1-ba50-1259e2957dff service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received event network-vif-plugged-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9ca316e5-75bb-4031-b770-cd7b2a3c5554 req-dece3f83-fa7b-43d1-ba50-1259e2957dff service nova] Acquiring lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9ca316e5-75bb-4031-b770-cd7b2a3c5554 req-dece3f83-fa7b-43d1-ba50-1259e2957dff service nova] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9ca316e5-75bb-4031-b770-cd7b2a3c5554 req-dece3f83-fa7b-43d1-ba50-1259e2957dff service nova] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-9ca316e5-75bb-4031-b770-cd7b2a3c5554 req-dece3f83-fa7b-43d1-ba50-1259e2957dff service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] No waiting events found dispatching network-vif-plugged-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:28:24 user nova-compute[82196]: WARNING nova.compute.manager [req-9ca316e5-75bb-4031-b770-cd7b2a3c5554 req-dece3f83-fa7b-43d1-ba50-1259e2957dff service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received unexpected event network-vif-plugged-4f568bd5-7271-434e-a30e-beb13759e1f1 for instance with vm_state building and task_state spawning.
Apr 11 19:28:24 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Instance spawned successfully.
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:28:24 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241304.0408509, 558100b9-f3ac-47c7-9260-b897b0cae55f => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:28:24 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] VM Started (Lifecycle Event)
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:28:24 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:28:24 user nova-compute[82196]: INFO nova.compute.manager [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Took 5.75 seconds to spawn the instance on the hypervisor.
Apr 11 19:28:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:24 user nova-compute[82196]: INFO nova.compute.manager [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Took 6.42 seconds to build instance.
Apr 11 19:28:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f806d29-62f1-4e60-81a9-e75d9cfecac8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.512s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-changed-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Refreshing instance network info cache due to event network-changed-9e6087aa-464a-450d-bd04-2653d9420094. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:28:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] Acquiring lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:28:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] Acquired lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:28:26 user nova-compute[82196]: DEBUG nova.network.neutron [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Refreshing network info cache for port 9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:28:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG nova.network.neutron [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updated VIF entry in instance network info cache for port 9e6087aa-464a-450d-bd04-2653d9420094. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG nova.network.neutron [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updating instance_info_cache with network_info: [{"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0ac74cec-c42d-4634-9bc3-7e40135d128b req-9b8d3400-c5b1-4464-869e-d7ec83ffd48b service nova] Releasing lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:28:27 user nova-compute[82196]: INFO nova.compute.claims [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Claim successful on node user
Apr 11 19:28:27 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:28:27 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:28:27 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:28:27 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:28:27 user nova-compute[82196]: INFO nova.virt.block_device [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Booting with blank volume at /dev/vda
Apr 11 19:28:27 user nova-compute[82196]: DEBUG nova.policy [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:28:28 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Successfully created port: 60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "720c683f-c03a-444c-92a8-daf97c9f524b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:29 user nova-compute[82196]: INFO nova.compute.manager [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Shelving
Apr 11 19:28:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-a72559eb-538c-47d3-a14b-f7f52ab7a9a6 req-17b11c5a-07e0-444a-8fe1-207c2c53d101 service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-vif-unplugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a72559eb-538c-47d3-a14b-f7f52ab7a9a6 req-17b11c5a-07e0-444a-8fe1-207c2c53d101 service nova] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a72559eb-538c-47d3-a14b-f7f52ab7a9a6 req-17b11c5a-07e0-444a-8fe1-207c2c53d101 service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a72559eb-538c-47d3-a14b-f7f52ab7a9a6 req-17b11c5a-07e0-444a-8fe1-207c2c53d101 service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-a72559eb-538c-47d3-a14b-f7f52ab7a9a6 req-17b11c5a-07e0-444a-8fe1-207c2c53d101 service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] No waiting events found dispatching network-vif-unplugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:28:29 user nova-compute[82196]: WARNING nova.compute.manager [req-a72559eb-538c-47d3-a14b-f7f52ab7a9a6 req-17b11c5a-07e0-444a-8fe1-207c2c53d101 service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received unexpected event network-vif-unplugged-9e6087aa-464a-450d-bd04-2653d9420094 for instance with vm_state active and task_state shelving.
Apr 11 19:28:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Successfully updated port: 60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquired lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-changed-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Refreshing instance network info cache due to event network-changed-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] Acquiring lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:28:29 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:28:29 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Instance destroyed successfully.
Apr 11 19:28:30 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Beginning cold snapshot process
Apr 11 19:28:30 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Updating instance_info_cache with network_info: [{"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Releasing lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:28:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Instance network_info: |[{"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:28:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] Acquired lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:28:30 user nova-compute[82196]: DEBUG nova.network.neutron [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Refreshing network info cache for port 60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:28:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:30 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:28:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk /opt/stack/data/nova/instances/snapshots/tmpy_mdcqa8/e4b8262292a7407a9a5b0c989a62ec86 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:30 user nova-compute[82196]: DEBUG nova.network.neutron [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Updated VIF entry in instance network info cache for port 60f272b0-f7d2-408b-b99b-9bcfcd3f23ff. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:28:30 user nova-compute[82196]: DEBUG nova.network.neutron [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Updating instance_info_cache with network_info: [{"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-51966969-21bf-402f-9c28-24e332fe1bc1 req-a0519e4b-5038-48aa-afa5-375f8b831a88 service nova] Releasing lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:28:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk /opt/stack/data/nova/instances/snapshots/tmpy_mdcqa8/e4b8262292a7407a9a5b0c989a62ec86" returned: 0 in 0.467s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:30 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Snapshot extracted, beginning image upload
Apr 11 19:28:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-1c6036f1-2c37-4fb7-a7e4-83fd70d1932e req-2f3f45c3-2baf-4694-aaad-a5a91a8e44bd service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1c6036f1-2c37-4fb7-a7e4-83fd70d1932e req-2f3f45c3-2baf-4694-aaad-a5a91a8e44bd service nova] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1c6036f1-2c37-4fb7-a7e4-83fd70d1932e req-2f3f45c3-2baf-4694-aaad-a5a91a8e44bd service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1c6036f1-2c37-4fb7-a7e4-83fd70d1932e req-2f3f45c3-2baf-4694-aaad-a5a91a8e44bd service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-1c6036f1-2c37-4fb7-a7e4-83fd70d1932e req-2f3f45c3-2baf-4694-aaad-a5a91a8e44bd service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] No waiting events found dispatching network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:28:31 user nova-compute[82196]: WARNING nova.compute.manager [req-1c6036f1-2c37-4fb7-a7e4-83fd70d1932e req-2f3f45c3-2baf-4694-aaad-a5a91a8e44bd service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received unexpected event network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 19:28:32 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:28:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Snapshot image upload complete
Apr 11 19:28:33 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:33 user nova-compute[82196]: INFO nova.compute.manager [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Shelve offloading
Apr 11 19:28:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Instance destroyed successfully.
Apr 11 19:28:33 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquired lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG os_brick.utils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0418adc-20eb-45ad-b53d-45c74d728860]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02de3bf-b834-45d5-b5e9-25a397b3539e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e4e81f-89a8-4088-89ed-6c8e043ba39e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7393a4-2dd5-47b2-9d73-ea228d0ce664]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:28:33 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[565417c4-dade-4128-8c5a-443b6d2b8cce]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG os_brick.utils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Updating existing volume attachment record: 934da42e-d955-4c25-b755-efbd83bed0d8 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updating instance_info_cache with network_info: [{"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Releasing lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:28:34 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Instance destroyed successfully.
Apr 11 19:28:34 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'resources' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1219064691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1219064691',id=20,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ82RBzB/1/A3FnM1xLWpDXU/zavewAraCLhBOFMjSAT73wEadTAAV/T3F8H/2XBNIlxPBMghQi8EI/lCPJr4+3PB4NLUhilDnSU8CjIwDu129bM+5w7HZBo//kKOchz0Q==',key_name='tempest-keypair-787762884',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8d8b189667e34931aa36149620a036e1',ramdisk_id='',reservation_id='r-qvcxbxdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-427928846',owner_user_name='tempest-AttachVolumeShelveTestJSON-427928846-project-member',shelved_at='2023-04-11T19:28:33.062307',shelved_host='user',shelved_image_id='8fc3d875-6ba4-4cd1-a98a-af1a6f47172f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0558ba5a2b04d36ba2f2411090cc4e4',uuid=720c683f-c03a-444c-92a8-daf97c9f524b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converting VIF {"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG os_vif [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e6087aa-46, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-changed-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Refreshing instance network info cache due to event network-changed-9e6087aa-464a-450d-bd04-2653d9420094. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] Acquiring lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] Acquired lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG nova.network.neutron [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Refreshing network info cache for port 9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:34 user nova-compute[82196]: INFO os_vif [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46')
Apr 11 19:28:34 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Deleting instance files /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b_del
Apr 11 19:28:34 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Deletion of /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b_del complete
Apr 11 19:28:34 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Deleted allocations for instance 720c683f-c03a-444c-92a8-daf97c9f524b
Apr 11 19:28:34 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'numa_topology' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG nova.network.neutron [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updated VIF entry in instance network info cache for port 9e6087aa-464a-450d-bd04-2653d9420094. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG nova.network.neutron [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updating instance_info_cache with network_info: [{"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9e6087aa-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ba3137fa-968c-4e4a-9651-e643da41d2e7 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "720c683f-c03a-444c-92a8-daf97c9f524b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.622s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-43df0799-5a11-4d36-bf20-ad808eb6f610 req-e5aa259f-d8bd-45ee-a21d-ed860db0e0fe service nova] Releasing lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:28:35 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:28:37 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Creating image(s)
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Ensure instance console log exists: /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Start _get_guest_xml network_info=[{"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBQxmzcq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '864fcd9b-8e5b-4de8-a2e6-292a8907a834', 'attached_at': '', 'detached_at': '', 'volume_id': '7c16a921-5f10-4a87-bd7c-2be0654eea21', 'serial': '7c16a921-5f10-4a87-bd7c-2be0654eea21'}, 'attachment_id': '934da42e-d955-4c25-b755-efbd83bed0d8', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:28:37 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:28:37 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBQxmzcq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:28:37 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:28:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:28:37 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:28:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:28:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:28:37 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:28:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f35aee-34c0-4c6f-9936-fa2021c68a4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:28:38 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac08a4f-f319-4e6b-8b0a-73d428f35e43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21] added
Apr 11 19:28:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[368868bd-0066-4605-a061-a8eac14b0656]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[313befd9-1aee-4675-b78d-16259c955600]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBQxmzcq {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBQxmzcq" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0464f684-ac08-43c3-88fe-55363cdda839]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FBQxmzcq'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cb0bf0-927e-414d-9c3c-90a5c452ce42]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9baec9-45d8-4d87-995e-c157d744bdfe]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:28:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:28:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9253674a-7044-42d1-9ea1-520d709cadc7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21, portal: 172.16.0.220,3260]
Apr 11 19:28:38 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21, portal: 172.16.0.220,3260] successful.
Apr 11 19:28:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a68c28-1adf-445f-bb88-254fc534c79b]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[454e53bb-5044-4e31-be37-a0e8c2ef61a0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:28:38 user nova-compute[82196]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:28:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:28:38 user nova-compute[82196]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:28:38 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da8b033-ed02-4f97-88e0-ce1a506b39a2]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBQxmzcq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquired lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'info_cache' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Updating instance_info_cache with network_info: [{"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Releasing lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23733383263643261', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733383263643261', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2079796435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2079796435',id=23,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-v6h0cyai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:28:28Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=864fcd9b-8e5b-4de8-a2e6-292a8907a834,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:10,bridge_name='br-int',has_traffic_filtering=True,id=60f272b0-f7d2-408b-b99b-9bcfcd3f23ff,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f272b0-f7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'pci_devices' on Instance uuid 864fcd9b-8e5b-4de8-a2e6-292a8907a834 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:28:39 user nova-compute[82196]:   <uuid>864fcd9b-8e5b-4de8-a2e6-292a8907a834</uuid>
Apr 11 19:28:39 user nova-compute[82196]:   <name>instance-00000017</name>
Apr 11 19:28:39 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:28:39 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:28:39 user nova-compute[82196]:   <metadata>
Apr 11 19:28:39 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:28:39 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:28:39 user nova-compute[82196]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2079796435</nova:name>
Apr 11 19:28:39 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:28:37</nova:creationTime>
Apr 11 19:28:39 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:28:39 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:28:39 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:28:39 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:28:39 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:28:39 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:28:39 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:28:39 user nova-compute[82196]:       <nova:owner>
Apr 11 19:28:39 user nova-compute[82196]:         <nova:user uuid="1b3adca432b04d70818a51d1366f5c6d">tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member</nova:user>
Apr 11 19:28:39 user nova-compute[82196]:         <nova:project uuid="eb91586feb3f4a4c84fa8c2183baaf8c">tempest-ServerBootFromVolumeStableRescueTest-863156619</nova:project>
Apr 11 19:28:39 user nova-compute[82196]:       </nova:owner>
Apr 11 19:28:39 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:28:39 user nova-compute[82196]:       <nova:ports>
Apr 11 19:28:39 user nova-compute[82196]:         <nova:port uuid="60f272b0-f7d2-408b-b99b-9bcfcd3f23ff">
Apr 11 19:28:39 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 19:28:39 user nova-compute[82196]:         </nova:port>
Apr 11 19:28:39 user nova-compute[82196]:       </nova:ports>
Apr 11 19:28:39 user nova-compute[82196]:     </nova:instance>
Apr 11 19:28:39 user nova-compute[82196]:   </metadata>
Apr 11 19:28:39 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:28:39 user nova-compute[82196]:     <system>
Apr 11 19:28:39 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:28:39 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:28:39 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:28:39 user nova-compute[82196]:       <entry name="serial">864fcd9b-8e5b-4de8-a2e6-292a8907a834</entry>
Apr 11 19:28:39 user nova-compute[82196]:       <entry name="uuid">864fcd9b-8e5b-4de8-a2e6-292a8907a834</entry>
Apr 11 19:28:39 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:28:39 user nova-compute[82196]:     </system>
Apr 11 19:28:39 user nova-compute[82196]:   </sysinfo>
Apr 11 19:28:39 user nova-compute[82196]:   <os>
Apr 11 19:28:39 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:28:39 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:28:39 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:28:39 user nova-compute[82196]:   </os>
Apr 11 19:28:39 user nova-compute[82196]:   <features>
Apr 11 19:28:39 user nova-compute[82196]:     <acpi/>
Apr 11 19:28:39 user nova-compute[82196]:     <apic/>
Apr 11 19:28:39 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:28:39 user nova-compute[82196]:   </features>
Apr 11 19:28:39 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:28:39 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:28:39 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:28:39 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:28:39 user nova-compute[82196]:   </clock>
Apr 11 19:28:39 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:28:39 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:28:39 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:28:39 user nova-compute[82196]:   </cpu>
Apr 11 19:28:39 user nova-compute[82196]:   <devices>
Apr 11 19:28:39 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:28:39 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:28:39 user nova-compute[82196]:       <source dev="/dev/sdb"/>
Apr 11 19:28:39 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:28:39 user nova-compute[82196]:       <serial>7c16a921-5f10-4a87-bd7c-2be0654eea21</serial>
Apr 11 19:28:39 user nova-compute[82196]:     </disk>
Apr 11 19:28:39 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:28:39 user nova-compute[82196]:       <mac address="fa:16:3e:db:2d:10"/>
Apr 11 19:28:39 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:28:39 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:28:39 user nova-compute[82196]:       <target dev="tap60f272b0-f7"/>
Apr 11 19:28:39 user nova-compute[82196]:     </interface>
Apr 11 19:28:39 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:28:39 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/console.log" append="off"/>
Apr 11 19:28:39 user nova-compute[82196]:     </serial>
Apr 11 19:28:39 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:28:39 user nova-compute[82196]:     <video>
Apr 11 19:28:39 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:28:39 user nova-compute[82196]:     </video>
Apr 11 19:28:39 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:28:39 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:28:39 user nova-compute[82196]:     </rng>
Apr 11 19:28:39 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:28:39 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:28:39 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:28:39 user nova-compute[82196]:     </memballoon>
Apr 11 19:28:39 user nova-compute[82196]:   </devices>
Apr 11 19:28:39 user nova-compute[82196]: </domain>
Apr 11 19:28:39 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2079796435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2079796435',id=23,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-v6h0cyai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:28:28Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=864fcd9b-8e5b-4de8-a2e6-292a8907a834,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:10,bridge_name='br-int',has_traffic_filtering=True,id=60f272b0-f7d2-408b-b99b-9bcfcd3f23ff,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f272b0-f7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_vif [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:10,bridge_name='br-int',has_traffic_filtering=True,id=60f272b0-f7d2-408b-b99b-9bcfcd3f23ff,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f272b0-f7') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:28:39 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance destroyed successfully.
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'resources' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60f272b0-f7, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60f272b0-f7, col_values=(('external_ids', {'iface-id': '60f272b0-f7d2-408b-b99b-9bcfcd3f23ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:2d:10', 'vm-uuid': '864fcd9b-8e5b-4de8-a2e6-292a8907a834'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1133297397',display_name='tempest-AttachVolumeTestJSON-server-1133297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1133297397',id=15,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOPD4tcuauGjUTVAuhtjF6Ujtk7F6BaqU+NEO4mmGMGLvyjwNgcmLISc53y0YOwfDCzVZpJizbGjjXjSyz46Q14bi5LzbNBxPb/IJFa2O26n4+/fWcXb8RJ3mMBruboVA==',key_name='tempest-keypair-1431410116',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d886d2ec5fc946b49af3c8ca7c8556c7',ramdisk_id='',reservation_id='r-57smpzsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2144032498',owner_user_name='tempest-AttachVolumeTestJSON-2144032498-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:26:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31c237e142784bd6aa460d6f1bf33400',uuid=6802f099-9236-4c79-a892-2963f1b15b0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converting VIF {"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_vif [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:39 user nova-compute[82196]: INFO os_vif [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:10,bridge_name='br-int',has_traffic_filtering=True,id=60f272b0-f7d2-408b-b99b-9bcfcd3f23ff,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f272b0-f7')
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6193819b-0c, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:39 user nova-compute[82196]: INFO os_vif [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c')
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKWyAxXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:28:39 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffed72a4-c2d2-40ee-b781-d009fda03b65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:28:39 user nova-compute[82196]: No targets found.
Apr 11 19:28:39 user nova-compute[82196]: iSNS:
Apr 11 19:28:39 user nova-compute[82196]: No targets found.
Apr 11 19:28:39 user nova-compute[82196]: STATIC:
Apr 11 19:28:39 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:28:39 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:28:39 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:28:39 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e
Apr 11 19:28:39 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:28:39 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:28:39 user nova-compute[82196]: FIRMWARE:
Apr 11 19:28:39 user nova-compute[82196]: No targets found.
Apr 11 19:28:39 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:28:39 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:28:39 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No VIF found with MAC fa:16:3e:db:2d:10, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08c9586-22ad-4026-a425-d81ba88b2774]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c746700-4df4-42a5-af19-8706090cea44]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:28:39 user nova-compute[82196]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:28:39 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:28:39 user nova-compute[82196]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:28:39 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9281ad9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e'): ({'sdc'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Removing single pathed devices sdc {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f78b78-78fb-4ba6-a753-100e4700169d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50d524a-8ff1-44ae-8eda-379434406c68]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flushing IO for device /dev/sdc {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a1e48b-9cea-46ad-93fc-33a2bfb2cda4]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faf1aef-88fd-4996-815c-138ff4f99b55]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a91a4c9-0a7f-44a8-a8e0-e214c9549a12]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[763e3bef-98a1-48b5-b655-36b871b2b20f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260]
Apr 11 19:28:39 user nova-compute[82196]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260] successful.
Apr 11 19:28:39 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24f7bad-e516-4b63-88af-2685161ca299]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] <== disconnect_volume: return (314ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Start _get_guest_xml network_info=[{"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKWyAxXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6802f099-9236-4c79-a892-2963f1b15b0e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae9e623b-e20a-47f6-8a7b-d48a85701e3e', 'serial': 'ae9e623b-e20a-47f6-8a7b-d48a85701e3e'}, 'attachment_id': 'a3872eae-51fd-4839-9e88-24e5f7d598a3', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'numa_topology' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:39 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:28:39 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKWyAxXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:28:39 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:28:39 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:28:39 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:28:39 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[19acfc9b-1994-4659-a3c8-bf3a850dbe39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241323.2159545, 864fcd9b-8e5b-4de8-a2e6-292a8907a834 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:28:43 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] VM Resumed (Lifecycle Event)
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:28:43 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-ea05dd9c-67f3-48c8-bcd7-4c7e817d331b req-9efa4a5c-a188-49e4-8fda-2eb2a75fbf55 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ea05dd9c-67f3-48c8-bcd7-4c7e817d331b req-9efa4a5c-a188-49e4-8fda-2eb2a75fbf55 service nova] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ea05dd9c-67f3-48c8-bcd7-4c7e817d331b req-9efa4a5c-a188-49e4-8fda-2eb2a75fbf55 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ea05dd9c-67f3-48c8-bcd7-4c7e817d331b req-9efa4a5c-a188-49e4-8fda-2eb2a75fbf55 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-ea05dd9c-67f3-48c8-bcd7-4c7e817d331b req-9efa4a5c-a188-49e4-8fda-2eb2a75fbf55 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] No waiting events found dispatching network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:28:43 user nova-compute[82196]: WARNING nova.compute.manager [req-ea05dd9c-67f3-48c8-bcd7-4c7e817d331b req-9efa4a5c-a188-49e4-8fda-2eb2a75fbf55 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received unexpected event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance with vm_state building and task_state spawning.
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-changed-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Refreshing instance network info cache due to event network-changed-e4e4888a-168a-4fe8-a43e-ee683b50a39a. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] Acquiring lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] Acquired lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.network.neutron [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Refreshing network info cache for port e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-c87a6fad-a4e1-481b-9ca6-7f93e8335015 req-10a7c2fc-d8d9-4035-821a-c8668562929e service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c87a6fad-a4e1-481b-9ca6-7f93e8335015 req-10a7c2fc-d8d9-4035-821a-c8668562929e service nova] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c87a6fad-a4e1-481b-9ca6-7f93e8335015 req-10a7c2fc-d8d9-4035-821a-c8668562929e service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c87a6fad-a4e1-481b-9ca6-7f93e8335015 req-10a7c2fc-d8d9-4035-821a-c8668562929e service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-c87a6fad-a4e1-481b-9ca6-7f93e8335015 req-10a7c2fc-d8d9-4035-821a-c8668562929e service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] No waiting events found dispatching network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:28:43 user nova-compute[82196]: WARNING nova.compute.manager [req-c87a6fad-a4e1-481b-9ca6-7f93e8335015 req-10a7c2fc-d8d9-4035-821a-c8668562929e service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received unexpected event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance with vm_state building and task_state spawning.
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab69e9d-7297-4225-a5e1-ca4a63ee7b6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e] added
Apr 11 19:28:43 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:43 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Instance spawned successfully.
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:28:43 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:28:43 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7868MB free_disk=26.2882080078125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[56024e49-d8b0-43b2-b577-d2af24417bfa]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:43 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241323.2161837, 864fcd9b-8e5b-4de8-a2e6-292a8907a834 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:28:43 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] VM Started (Lifecycle Event)
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[287a02bd-7b3a-4528-822c-ea6970507440]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKWyAxXC {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKWyAxXC" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a01960d-d107-4d3e-8bcf-cc537e66df09]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JKWyAxXC'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[55740399-00d2-4928-9633-ccdeef4b008b]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:43 user nova-compute[82196]: INFO nova.compute.manager [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Took 5.79 seconds to spawn the instance on the hypervisor.
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b295e02c-153e-4fdb-a876-de7f16356b04]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:28:43 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:28:43 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:28:43 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[578ffcc1-d4de-4a53-8c05-9bbfeff5f28f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260]
Apr 11 19:28:43 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260] successful.
Apr 11 19:28:43 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6802f099-9236-4c79-a892-2963f1b15b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 558100b9-f3ac-47c7-9260-b897b0cae55f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae88c38f-fef7-49c4-ac6f-b76a9dd73867]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[47881645-1751-4fec-8405-040373713156]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:28:43 user nova-compute[82196]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:28:43 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:28:43 user nova-compute[82196]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:28:43 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 3.879s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:28:43 user nova-compute[82196]: INFO nova.compute.manager [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Took 16.60 seconds to build instance.
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c706b875-8324-439b-8751-1559f2e0587f]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1eabaf02-6180-4846-aff2-ceb2985813e1 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.702s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:28:43 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKWyAxXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.network.neutron [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updated VIF entry in instance network info cache for port e4e4888a-168a-4fe8-a43e-ee683b50a39a. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.network.neutron [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating instance_info_cache with network_info: [{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a6c7fafc-de76-4212-b635-640ea1294593 req-73935045-1783-40ed-8a29-93ddbd881783 service nova] Releasing lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.918s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] <== connect_volume: return (4920ms) {'type': 'block', 'scsi_wwn': '26235306430343930', 'path': '/dev/sdc'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235306430343930', 'path': '/dev/sdc'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1133297397',display_name='tempest-AttachVolumeTestJSON-server-1133297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1133297397',id=15,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOPD4tcuauGjUTVAuhtjF6Ujtk7F6BaqU+NEO4mmGMGLvyjwNgcmLISc53y0YOwfDCzVZpJizbGjjXjSyz46Q14bi5LzbNBxPb/IJFa2O26n4+/fWcXb8RJ3mMBruboVA==',key_name='tempest-keypair-1431410116',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d886d2ec5fc946b49af3c8ca7c8556c7',ramdisk_id='',reservation_id='r-57smpzsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2144032498',owner_user_name='tempest-AttachVolumeTestJSON-2144032498-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:26:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31c237e142784bd6aa460d6f1bf33400',uuid=6802f099-9236-4c79-a892-2963f1b15b0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converting VIF {"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'pci_devices' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:28:44 user nova-compute[82196]:   <uuid>6802f099-9236-4c79-a892-2963f1b15b0e</uuid>
Apr 11 19:28:44 user nova-compute[82196]:   <name>instance-0000000f</name>
Apr 11 19:28:44 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:28:44 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:28:44 user nova-compute[82196]:   <metadata>
Apr 11 19:28:44 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:28:44 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:28:44 user nova-compute[82196]:       <nova:name>tempest-AttachVolumeTestJSON-server-1133297397</nova:name>
Apr 11 19:28:44 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:28:39</nova:creationTime>
Apr 11 19:28:44 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:28:44 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:28:44 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:28:44 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:28:44 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:28:44 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:28:44 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:28:44 user nova-compute[82196]:       <nova:owner>
Apr 11 19:28:44 user nova-compute[82196]:         <nova:user uuid="31c237e142784bd6aa460d6f1bf33400">tempest-AttachVolumeTestJSON-2144032498-project-member</nova:user>
Apr 11 19:28:44 user nova-compute[82196]:         <nova:project uuid="d886d2ec5fc946b49af3c8ca7c8556c7">tempest-AttachVolumeTestJSON-2144032498</nova:project>
Apr 11 19:28:44 user nova-compute[82196]:       </nova:owner>
Apr 11 19:28:44 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:28:44 user nova-compute[82196]:       <nova:ports>
Apr 11 19:28:44 user nova-compute[82196]:         <nova:port uuid="6193819b-0c1b-476b-b89e-dbbfc7938fc5">
Apr 11 19:28:44 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 19:28:44 user nova-compute[82196]:         </nova:port>
Apr 11 19:28:44 user nova-compute[82196]:       </nova:ports>
Apr 11 19:28:44 user nova-compute[82196]:     </nova:instance>
Apr 11 19:28:44 user nova-compute[82196]:   </metadata>
Apr 11 19:28:44 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:28:44 user nova-compute[82196]:     <system>
Apr 11 19:28:44 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:28:44 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:28:44 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:28:44 user nova-compute[82196]:       <entry name="serial">6802f099-9236-4c79-a892-2963f1b15b0e</entry>
Apr 11 19:28:44 user nova-compute[82196]:       <entry name="uuid">6802f099-9236-4c79-a892-2963f1b15b0e</entry>
Apr 11 19:28:44 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:28:44 user nova-compute[82196]:     </system>
Apr 11 19:28:44 user nova-compute[82196]:   </sysinfo>
Apr 11 19:28:44 user nova-compute[82196]:   <os>
Apr 11 19:28:44 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:28:44 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:28:44 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:28:44 user nova-compute[82196]:   </os>
Apr 11 19:28:44 user nova-compute[82196]:   <features>
Apr 11 19:28:44 user nova-compute[82196]:     <acpi/>
Apr 11 19:28:44 user nova-compute[82196]:     <apic/>
Apr 11 19:28:44 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:28:44 user nova-compute[82196]:   </features>
Apr 11 19:28:44 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:28:44 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:28:44 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:28:44 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:28:44 user nova-compute[82196]:   </clock>
Apr 11 19:28:44 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:28:44 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:28:44 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:28:44 user nova-compute[82196]:   </cpu>
Apr 11 19:28:44 user nova-compute[82196]:   <devices>
Apr 11 19:28:44 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:28:44 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:28:44 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk"/>
Apr 11 19:28:44 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:28:44 user nova-compute[82196]:     </disk>
Apr 11 19:28:44 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:28:44 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:28:44 user nova-compute[82196]:       <source dev="/dev/sdc"/>
Apr 11 19:28:44 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:28:44 user nova-compute[82196]:       <serial>ae9e623b-e20a-47f6-8a7b-d48a85701e3e</serial>
Apr 11 19:28:44 user nova-compute[82196]:     </disk>
Apr 11 19:28:44 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:28:44 user nova-compute[82196]:       <mac address="fa:16:3e:ce:17:72"/>
Apr 11 19:28:44 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:28:44 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:28:44 user nova-compute[82196]:       <target dev="tap6193819b-0c"/>
Apr 11 19:28:44 user nova-compute[82196]:     </interface>
Apr 11 19:28:44 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:28:44 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/console.log" append="off"/>
Apr 11 19:28:44 user nova-compute[82196]:     </serial>
Apr 11 19:28:44 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:28:44 user nova-compute[82196]:     <video>
Apr 11 19:28:44 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:28:44 user nova-compute[82196]:     </video>
Apr 11 19:28:44 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:28:44 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:28:44 user nova-compute[82196]:     </rng>
Apr 11 19:28:44 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:28:44 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:28:44 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:28:44 user nova-compute[82196]:     </memballoon>
Apr 11 19:28:44 user nova-compute[82196]:   </devices>
Apr 11 19:28:44 user nova-compute[82196]: </domain>
Apr 11 19:28:44 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241309.9480631, 720c683f-c03a-444c-92a8-daf97c9f524b => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:28:44 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] VM Stopped (Lifecycle Event)
Apr 11 19:28:44 user nova-compute[82196]: DEBUG nova.compute.manager [None req-9c24b625-2a7e-4c15-a538-ac687f9888d7 None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Cannot resize image /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'migration_context' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1133297397',display_name='tempest-AttachVolumeTestJSON-server-1133297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1133297397',id=15,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOPD4tcuauGjUTVAuhtjF6Ujtk7F6BaqU+NEO4mmGMGLvyjwNgcmLISc53y0YOwfDCzVZpJizbGjjXjSyz46Q14bi5LzbNBxPb/IJFa2O26n4+/fWcXb8RJ3mMBruboVA==',key_name='tempest-keypair-1431410116',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d886d2ec5fc946b49af3c8ca7c8556c7',ramdisk_id='',reservation_id='r-57smpzsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2144032498',owner_user_name='tempest-AttachVolumeTestJSON-2144032498-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:26:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31c237e142784bd6aa460d6f1bf33400',uuid=6802f099-9236-4c79-a892-2963f1b15b0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converting VIF {"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG os_vif [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6193819b-0c, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6193819b-0c, col_values=(('external_ids', {'iface-id': '6193819b-0c1b-476b-b89e-dbbfc7938fc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:17:72', 'vm-uuid': '6802f099-9236-4c79-a892-2963f1b15b0e'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:45 user nova-compute[82196]: INFO os_vif [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c')
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updating instance_info_cache with network_info: [{"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-aa0bb9aa-a93d-45bc-9f90-46eeb6416365" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:28:45 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:46 user nova-compute[82196]: INFO nova.compute.manager [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Terminating instance
Apr 11 19:28:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-e323e1df-e033-4c0e-b7d8-901491175e23 req-b63837ea-7926-40d7-ac80-8b238883fa92 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-unplugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e323e1df-e033-4c0e-b7d8-901491175e23 req-b63837ea-7926-40d7-ac80-8b238883fa92 service nova] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e323e1df-e033-4c0e-b7d8-901491175e23 req-b63837ea-7926-40d7-ac80-8b238883fa92 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e323e1df-e033-4c0e-b7d8-901491175e23 req-b63837ea-7926-40d7-ac80-8b238883fa92 service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-e323e1df-e033-4c0e-b7d8-901491175e23 req-b63837ea-7926-40d7-ac80-8b238883fa92 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] No waiting events found dispatching network-vif-unplugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-e323e1df-e033-4c0e-b7d8-901491175e23 req-b63837ea-7926-40d7-ac80-8b238883fa92 service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-unplugged-5a15e207-1839-4be5-80b2-fc995098dbbf for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:47 user nova-compute[82196]: INFO nova.compute.manager [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Terminating instance
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.compute.manager [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Instance destroyed successfully.
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lazy-loading 'resources' on Instance uuid aa0bb9aa-a93d-45bc-9f90-46eeb6416365 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-309951304',display_name='tempest-ServerStableDeviceRescueTest-server-309951304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-309951304',id=4,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQPHRAJfFRFeAUt5MqGdWAF2Vw2uFd+0nfpM413xhOuBbSDaV6LfVNTeVPCQwsh3pP3/wPGteAXUcszYrP1qam1IH+EIRD9QQUduJX8PlHQPLpnCt50NfjnO6EpONvQTg==',key_name='tempest-keypair-909036118',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:25:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11ee7c68b277420ba524c2a99cd444ea',ramdisk_id='',reservation_id='r-hjoe23y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-400855764',owner_user_name='tempest-ServerStableDeviceRescueTest-400855764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:27:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26f091a1508b4d2689005b660f6a1380',uuid=aa0bb9aa-a93d-45bc-9f90-46eeb6416365,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Converting VIF {"id": "5a15e207-1839-4be5-80b2-fc995098dbbf", "address": "fa:16:3e:eb:eb:fe", "network": {"id": "e637d15d-90c0-48cc-8229-ffd26c0be8c6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1164664069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11ee7c68b277420ba524c2a99cd444ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a15e207-18", "ovs_interfaceid": "5a15e207-1839-4be5-80b2-fc995098dbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:eb:fe,bridge_name='br-int',has_traffic_filtering=True,id=5a15e207-1839-4be5-80b2-fc995098dbbf,network=Network(e637d15d-90c0-48cc-8229-ffd26c0be8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a15e207-18') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG os_vif [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:eb:fe,bridge_name='br-int',has_traffic_filtering=True,id=5a15e207-1839-4be5-80b2-fc995098dbbf,network=Network(e637d15d-90c0-48cc-8229-ffd26c0be8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a15e207-18') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a15e207-18, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: INFO os_vif [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:eb:fe,bridge_name='br-int',has_traffic_filtering=True,id=5a15e207-1839-4be5-80b2-fc995098dbbf,network=Network(e637d15d-90c0-48cc-8229-ffd26c0be8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a15e207-18')
Apr 11 19:28:47 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Deleting instance files /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365_del
Apr 11 19:28:47 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Deletion of /opt/stack/data/nova/instances/aa0bb9aa-a93d-45bc-9f90-46eeb6416365_del complete
Apr 11 19:28:47 user nova-compute[82196]: INFO nova.compute.manager [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Took 1.32 seconds to destroy the instance on the hypervisor.
Apr 11 19:28:47 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Instance destroyed successfully.
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.objects.instance [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'resources' on Instance uuid f37ed08c-8c9a-4af7-ba5f-b8a942e54389 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-222957451',display_name='tempest-TestStampPattern-server-222957451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-222957451',id=19,image_ref='d7d799c2-1b6d-4055-a3ab-a4130305113e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk/F931FMuqnj9QLMI+pGBS0j8hrERQZ0hcpFPwqT+C/Srrx02ZenEuPQP/CTs/VLAlwECMwCuedYJB3t1d4C9VnWF3rrxqO6dqYPkLQMKZthDnoCY8H8zWO0Un/+Ismw==',key_name='tempest-TestStampPattern-1385471309',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:26:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bceca6e3506e43f68f9cf8d0b56d141b',ramdisk_id='',reservation_id='r-s3h1o6hs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d424f88d-5f82-4cac-aa0f-4f99624bd3e7',image_min_disk='1',image_min_ram='0',image_owner_id='bceca6e3506e43f68f9cf8d0b56d141b',image_owner_project_name='tempest-TestStampPattern-497408287',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-497408287-project-member',image_user_id='3a32a5d0547141a180f655e98567ed9a',owner_project_name='tempest-TestStampPattern-497408287',owner_user_name='tempest-TestStampPattern-497408287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:26:03Z,user_data=None,user_id='3a32a5d0547141a180f655e98567ed9a',uuid=f37ed08c-8c9a-4af7-ba5f-b8a942e54389,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "address": "fa:16:3e:7e:08:f3", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77bd0f58-75", "ovs_interfaceid": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Converting VIF {"id": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "address": "fa:16:3e:7e:08:f3", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77bd0f58-75", "ovs_interfaceid": "77bd0f58-75d0-4cc3-ab98-4f4b31401482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:08:f3,bridge_name='br-int',has_traffic_filtering=True,id=77bd0f58-75d0-4cc3-ab98-4f4b31401482,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77bd0f58-75') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG os_vif [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:08:f3,bridge_name='br-int',has_traffic_filtering=True,id=77bd0f58-75d0-4cc3-ab98-4f4b31401482,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77bd0f58-75') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77bd0f58-75, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:28:47 user nova-compute[82196]: INFO os_vif [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:08:f3,bridge_name='br-int',has_traffic_filtering=True,id=77bd0f58-75d0-4cc3-ab98-4f4b31401482,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77bd0f58-75')
Apr 11 19:28:47 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Deleting instance files /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389_del
Apr 11 19:28:47 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Deletion of /opt/stack/data/nova/instances/f37ed08c-8c9a-4af7-ba5f-b8a942e54389_del complete
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:47 user nova-compute[82196]: INFO nova.compute.manager [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 11 19:28:47 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:28:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-374cbf31-86bb-4cc1-89b0-9ab965b78e8e req-3abd8b6d-599e-405a-9886-0b43ec13173e service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Received event network-vif-unplugged-77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-374cbf31-86bb-4cc1-89b0-9ab965b78e8e req-3abd8b6d-599e-405a-9886-0b43ec13173e service nova] Acquiring lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-374cbf31-86bb-4cc1-89b0-9ab965b78e8e req-3abd8b6d-599e-405a-9886-0b43ec13173e service nova] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-374cbf31-86bb-4cc1-89b0-9ab965b78e8e req-3abd8b6d-599e-405a-9886-0b43ec13173e service nova] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-374cbf31-86bb-4cc1-89b0-9ab965b78e8e req-3abd8b6d-599e-405a-9886-0b43ec13173e service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] No waiting events found dispatching network-vif-unplugged-77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-374cbf31-86bb-4cc1-89b0-9ab965b78e8e req-3abd8b6d-599e-405a-9886-0b43ec13173e service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Received event network-vif-unplugged-77bd0f58-75d0-4cc3-ab98-4f4b31401482 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:48 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Took 0.72 seconds to deallocate network for instance.
Apr 11 19:28:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:48 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Deleted allocations for instance aa0bb9aa-a93d-45bc-9f90-46eeb6416365
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b1c7d88f-38fb-4306-a47b-9395fb550cb2 tempest-ServerStableDeviceRescueTest-400855764 tempest-ServerStableDeviceRescueTest-400855764-project-member] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.598s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Received event network-changed-77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Refreshing instance network info cache due to event network-changed-77bd0f58-75d0-4cc3-ab98-4f4b31401482. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Acquiring lock "refresh_cache-f37ed08c-8c9a-4af7-ba5f-b8a942e54389" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Acquired lock "refresh_cache-f37ed08c-8c9a-4af7-ba5f-b8a942e54389" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.network.neutron [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Refreshing network info cache for port 77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:48 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Took 0.95 seconds to deallocate network for instance.
Apr 11 19:28:48 user nova-compute[82196]: INFO nova.network.neutron [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Port 77bd0f58-75d0-4cc3-ab98-4f4b31401482 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.network.neutron [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Releasing lock "refresh_cache-f37ed08c-8c9a-4af7-ba5f-b8a942e54389" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Acquiring lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Lock "aa0bb9aa-a93d-45bc-9f90-46eeb6416365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] No waiting events found dispatching network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:28:48 user nova-compute[82196]: WARNING nova.compute.manager [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received unexpected event network-vif-plugged-5a15e207-1839-4be5-80b2-fc995098dbbf for instance with vm_state deleted and task_state None.
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] No waiting events found dispatching network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:28:48 user nova-compute[82196]: WARNING nova.compute.manager [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received unexpected event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance with vm_state stopped and task_state powering-on.
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] No waiting events found dispatching network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:28:48 user nova-compute[82196]: WARNING nova.compute.manager [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received unexpected event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance with vm_state stopped and task_state powering-on.
Apr 11 19:28:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-95f22689-c73f-4eee-913b-2da0d8691755 req-17bbe51e-3cac-465e-8ced-16c814dd81ca service nova] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Received event network-vif-deleted-5a15e207-1839-4be5-80b2-fc995098dbbf {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:49 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:28:49 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:28:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:49 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Deleted allocations for instance f37ed08c-8c9a-4af7-ba5f-b8a942e54389
Apr 11 19:28:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-cfcd89ca-e290-4ba7-9ffd-7937aac48bba tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.367s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:49 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241329.6771097, 6802f099-9236-4c79-a892-2963f1b15b0e => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:28:49 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] VM Resumed (Lifecycle Event)
Apr 11 19:28:49 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:28:49 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance rebooted successfully.
Apr 11 19:28:49 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ce7f5420-a25e-4e7e-a044-98ded7f5a401 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:49 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:49 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:28:49 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 19:28:49 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241329.680866, 6802f099-9236-4c79-a892-2963f1b15b0e => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:28:49 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] VM Started (Lifecycle Event)
Apr 11 19:28:49 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:28:49 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:28:50 user nova-compute[82196]: DEBUG nova.compute.manager [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Received event network-vif-plugged-77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] Acquiring lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:28:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:28:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] Lock "f37ed08c-8c9a-4af7-ba5f-b8a942e54389-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:28:50 user nova-compute[82196]: DEBUG nova.compute.manager [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] No waiting events found dispatching network-vif-plugged-77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:28:50 user nova-compute[82196]: WARNING nova.compute.manager [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Received unexpected event network-vif-plugged-77bd0f58-75d0-4cc3-ab98-4f4b31401482 for instance with vm_state deleted and task_state None.
Apr 11 19:28:50 user nova-compute[82196]: DEBUG nova.compute.manager [req-29c48184-d60d-4774-805e-7f410a513b37 req-f3cf5331-d6a2-480c-9858-364f8c227759 service nova] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Received event network-vif-deleted-77bd0f58-75d0-4cc3-ab98-4f4b31401482 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:28:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:28:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:02 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241327.472854, aa0bb9aa-a93d-45bc-9f90-46eeb6416365 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:29:02 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] VM Stopped (Lifecycle Event)
Apr 11 19:29:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-5ea8b66c-f97b-4049-a8b4-26b54eabed4b None None] [instance: aa0bb9aa-a93d-45bc-9f90-46eeb6416365] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:29:02 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241327.8606331, f37ed08c-8c9a-4af7-ba5f-b8a942e54389 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:29:02 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] VM Stopped (Lifecycle Event)
Apr 11 19:29:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4f954a8b-5571-42ae-981b-38f7413131c6 None None] [instance: f37ed08c-8c9a-4af7-ba5f-b8a942e54389] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:29:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:07 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:29:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:29:09 user nova-compute[82196]: INFO nova.compute.claims [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Claim successful on node user
Apr 11 19:29:10 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:29:10 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:29:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:29:10 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Creating image(s)
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "/opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "/opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "/opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG nova.policy [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '996881d74ec246f0ac53411a8ca0e7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e983656394754cf68837587d74f9fbb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.132s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.132s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk 1073741824" returned: 0 in 0.063s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.127s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:29:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Cannot resize image /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lazy-loading 'migration_context' on Instance uuid 9466c3da-2c99-41ea-9fb4-41ffbaa9910a {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Ensure instance console log exists: /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Successfully created port: 32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Successfully updated port: 32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "refresh_cache-9466c3da-2c99-41ea-9fb4-41ffbaa9910a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquired lock "refresh_cache-9466c3da-2c99-41ea-9fb4-41ffbaa9910a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Received event network-changed-32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Refreshing instance network info cache due to event network-changed-32cb9325-7443-4bd8-ad26-e54700ba6bf4. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] Acquiring lock "refresh_cache-9466c3da-2c99-41ea-9fb4-41ffbaa9910a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:29:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Updating instance_info_cache with network_info: [{"id": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "address": "fa:16:3e:4c:10:03", "network": {"id": "fdd61e06-072c-4b1b-bd29-b291c80fd5a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fbdf09eea41f454e9a1bb9864af731dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32cb9325-74", "ovs_interfaceid": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Releasing lock "refresh_cache-9466c3da-2c99-41ea-9fb4-41ffbaa9910a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Instance network_info: |[{"id": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "address": "fa:16:3e:4c:10:03", "network": {"id": "fdd61e06-072c-4b1b-bd29-b291c80fd5a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fbdf09eea41f454e9a1bb9864af731dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32cb9325-74", "ovs_interfaceid": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] Acquired lock "refresh_cache-9466c3da-2c99-41ea-9fb4-41ffbaa9910a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.network.neutron [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Refreshing network info cache for port 32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Start _get_guest_xml network_info=[{"id": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "address": "fa:16:3e:4c:10:03", "network": {"id": "fdd61e06-072c-4b1b-bd29-b291c80fd5a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fbdf09eea41f454e9a1bb9864af731dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32cb9325-74", "ovs_interfaceid": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:29:12 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:29:12 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1598011629',display_name='tempest-VolumesNegativeTest-instance-1598011629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1598011629',id=24,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e983656394754cf68837587d74f9fbb3',ramdisk_id='',reservation_id='r-5jyooytq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1402597116',owner_user_name='tempest-VolumesNegativeTest-1402597116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:29:10Z,user_data=None,user_id='996881d74ec246f0ac53411a8ca0e7c4',uuid=9466c3da-2c99-41ea-9fb4-41ffbaa9910a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "address": "fa:16:3e:4c:10:03", "network": {"id": "fdd61e06-072c-4b1b-bd29-b291c80fd5a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fbdf09eea41f454e9a1bb9864af731dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32cb9325-74", "ovs_interfaceid": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Converting VIF {"id": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "address": "fa:16:3e:4c:10:03", "network": {"id": "fdd61e06-072c-4b1b-bd29-b291c80fd5a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fbdf09eea41f454e9a1bb9864af731dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32cb9325-74", "ovs_interfaceid": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:10:03,bridge_name='br-int',has_traffic_filtering=True,id=32cb9325-7443-4bd8-ad26-e54700ba6bf4,network=Network(fdd61e06-072c-4b1b-bd29-b291c80fd5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32cb9325-74') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lazy-loading 'pci_devices' on Instance uuid 9466c3da-2c99-41ea-9fb4-41ffbaa9910a {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:29:12 user nova-compute[82196]:   <uuid>9466c3da-2c99-41ea-9fb4-41ffbaa9910a</uuid>
Apr 11 19:29:12 user nova-compute[82196]:   <name>instance-00000018</name>
Apr 11 19:29:12 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:29:12 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:29:12 user nova-compute[82196]:   <metadata>
Apr 11 19:29:12 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:29:12 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:29:12 user nova-compute[82196]:       <nova:name>tempest-VolumesNegativeTest-instance-1598011629</nova:name>
Apr 11 19:29:12 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:29:12</nova:creationTime>
Apr 11 19:29:12 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:29:12 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:29:12 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:29:12 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:29:12 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:29:12 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:29:12 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:29:12 user nova-compute[82196]:       <nova:owner>
Apr 11 19:29:12 user nova-compute[82196]:         <nova:user uuid="996881d74ec246f0ac53411a8ca0e7c4">tempest-VolumesNegativeTest-1402597116-project-member</nova:user>
Apr 11 19:29:12 user nova-compute[82196]:         <nova:project uuid="e983656394754cf68837587d74f9fbb3">tempest-VolumesNegativeTest-1402597116</nova:project>
Apr 11 19:29:12 user nova-compute[82196]:       </nova:owner>
Apr 11 19:29:12 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:29:12 user nova-compute[82196]:       <nova:ports>
Apr 11 19:29:12 user nova-compute[82196]:         <nova:port uuid="32cb9325-7443-4bd8-ad26-e54700ba6bf4">
Apr 11 19:29:12 user nova-compute[82196]:           <nova:ip type="fixed" address="192.168.233.100" ipVersion="4"/>
Apr 11 19:29:12 user nova-compute[82196]:         </nova:port>
Apr 11 19:29:12 user nova-compute[82196]:       </nova:ports>
Apr 11 19:29:12 user nova-compute[82196]:     </nova:instance>
Apr 11 19:29:12 user nova-compute[82196]:   </metadata>
Apr 11 19:29:12 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:29:12 user nova-compute[82196]:     <system>
Apr 11 19:29:12 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:29:12 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:29:12 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:29:12 user nova-compute[82196]:       <entry name="serial">9466c3da-2c99-41ea-9fb4-41ffbaa9910a</entry>
Apr 11 19:29:12 user nova-compute[82196]:       <entry name="uuid">9466c3da-2c99-41ea-9fb4-41ffbaa9910a</entry>
Apr 11 19:29:12 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:29:12 user nova-compute[82196]:     </system>
Apr 11 19:29:12 user nova-compute[82196]:   </sysinfo>
Apr 11 19:29:12 user nova-compute[82196]:   <os>
Apr 11 19:29:12 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:29:12 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:29:12 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:29:12 user nova-compute[82196]:   </os>
Apr 11 19:29:12 user nova-compute[82196]:   <features>
Apr 11 19:29:12 user nova-compute[82196]:     <acpi/>
Apr 11 19:29:12 user nova-compute[82196]:     <apic/>
Apr 11 19:29:12 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:29:12 user nova-compute[82196]:   </features>
Apr 11 19:29:12 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:29:12 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:29:12 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:29:12 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:29:12 user nova-compute[82196]:   </clock>
Apr 11 19:29:12 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:29:12 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:29:12 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:29:12 user nova-compute[82196]:   </cpu>
Apr 11 19:29:12 user nova-compute[82196]:   <devices>
Apr 11 19:29:12 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:29:12 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:29:12 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk"/>
Apr 11 19:29:12 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:29:12 user nova-compute[82196]:     </disk>
Apr 11 19:29:12 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:29:12 user nova-compute[82196]:       <mac address="fa:16:3e:4c:10:03"/>
Apr 11 19:29:12 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:29:12 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:29:12 user nova-compute[82196]:       <target dev="tap32cb9325-74"/>
Apr 11 19:29:12 user nova-compute[82196]:     </interface>
Apr 11 19:29:12 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:29:12 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/console.log" append="off"/>
Apr 11 19:29:12 user nova-compute[82196]:     </serial>
Apr 11 19:29:12 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:29:12 user nova-compute[82196]:     <video>
Apr 11 19:29:12 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:29:12 user nova-compute[82196]:     </video>
Apr 11 19:29:12 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:29:12 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:29:12 user nova-compute[82196]:     </rng>
Apr 11 19:29:12 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:29:12 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:29:12 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:29:12 user nova-compute[82196]:     </memballoon>
Apr 11 19:29:12 user nova-compute[82196]:   </devices>
Apr 11 19:29:12 user nova-compute[82196]: </domain>
Apr 11 19:29:12 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1598011629',display_name='tempest-VolumesNegativeTest-instance-1598011629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1598011629',id=24,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e983656394754cf68837587d74f9fbb3',ramdisk_id='',reservation_id='r-5jyooytq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1402597116',owner_user_name='tempest-VolumesNegativeTest-1402597116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:29:10Z,user_data=None,user_id='996881d74ec246f0ac53411a8ca0e7c4',uuid=9466c3da-2c99-41ea-9fb4-41ffbaa9910a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "address": "fa:16:3e:4c:10:03", "network": {"id": "fdd61e06-072c-4b1b-bd29-b291c80fd5a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fbdf09eea41f454e9a1bb9864af731dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32cb9325-74", "ovs_interfaceid": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Converting VIF {"id": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "address": "fa:16:3e:4c:10:03", "network": {"id": "fdd61e06-072c-4b1b-bd29-b291c80fd5a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fbdf09eea41f454e9a1bb9864af731dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32cb9325-74", "ovs_interfaceid": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:10:03,bridge_name='br-int',has_traffic_filtering=True,id=32cb9325-7443-4bd8-ad26-e54700ba6bf4,network=Network(fdd61e06-072c-4b1b-bd29-b291c80fd5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32cb9325-74') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG os_vif [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:10:03,bridge_name='br-int',has_traffic_filtering=True,id=32cb9325-7443-4bd8-ad26-e54700ba6bf4,network=Network(fdd61e06-072c-4b1b-bd29-b291c80fd5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32cb9325-74') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32cb9325-74, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32cb9325-74, col_values=(('external_ids', {'iface-id': '32cb9325-7443-4bd8-ad26-e54700ba6bf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:10:03', 'vm-uuid': '9466c3da-2c99-41ea-9fb4-41ffbaa9910a'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:12 user nova-compute[82196]: INFO os_vif [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:10:03,bridge_name='br-int',has_traffic_filtering=True,id=32cb9325-7443-4bd8-ad26-e54700ba6bf4,network=Network(fdd61e06-072c-4b1b-bd29-b291c80fd5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32cb9325-74')
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:29:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] No VIF found with MAC fa:16:3e:4c:10:03, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:29:13 user nova-compute[82196]: DEBUG nova.network.neutron [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Updated VIF entry in instance network info cache for port 32cb9325-7443-4bd8-ad26-e54700ba6bf4. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:29:13 user nova-compute[82196]: DEBUG nova.network.neutron [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Updating instance_info_cache with network_info: [{"id": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "address": "fa:16:3e:4c:10:03", "network": {"id": "fdd61e06-072c-4b1b-bd29-b291c80fd5a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fbdf09eea41f454e9a1bb9864af731dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32cb9325-74", "ovs_interfaceid": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:29:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b23df32d-9586-467b-a410-e1cf962877ec req-bc039218-c1a4-4a62-be71-cb1c38905bcb service nova] Releasing lock "refresh_cache-9466c3da-2c99-41ea-9fb4-41ffbaa9910a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:29:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-133d2d87-afbb-4c27-b6e9-0f426677170d req-e842361b-8bac-482e-a739-93d86968d01f service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Received event network-vif-plugged-32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-133d2d87-afbb-4c27-b6e9-0f426677170d req-e842361b-8bac-482e-a739-93d86968d01f service nova] Acquiring lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-133d2d87-afbb-4c27-b6e9-0f426677170d req-e842361b-8bac-482e-a739-93d86968d01f service nova] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-133d2d87-afbb-4c27-b6e9-0f426677170d req-e842361b-8bac-482e-a739-93d86968d01f service nova] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-133d2d87-afbb-4c27-b6e9-0f426677170d req-e842361b-8bac-482e-a739-93d86968d01f service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] No waiting events found dispatching network-vif-plugged-32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:29:14 user nova-compute[82196]: WARNING nova.compute.manager [req-133d2d87-afbb-4c27-b6e9-0f426677170d req-e842361b-8bac-482e-a739-93d86968d01f service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Received unexpected event network-vif-plugged-32cb9325-7443-4bd8-ad26-e54700ba6bf4 for instance with vm_state building and task_state spawning.
Apr 11 19:29:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241355.703186, 9466c3da-2c99-41ea-9fb4-41ffbaa9910a => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:29:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] VM Resumed (Lifecycle Event)
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:29:15 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Instance spawned successfully.
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241355.7059443, 9466c3da-2c99-41ea-9fb4-41ffbaa9910a => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:29:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] VM Started (Lifecycle Event)
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:29:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:29:15 user nova-compute[82196]: INFO nova.compute.manager [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Took 5.32 seconds to spawn the instance on the hypervisor.
Apr 11 19:29:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:29:15 user nova-compute[82196]: INFO nova.compute.manager [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Took 5.94 seconds to build instance.
Apr 11 19:29:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3d87739a-d9e7-43fd-af3b-50df459faa58 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.045s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:16 user nova-compute[82196]: DEBUG nova.compute.manager [req-8361fb9d-c8c2-4f7e-b5d9-8575e25eef9d req-239b9a00-1eac-41a6-a6e7-2c0e1aa031c5 service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Received event network-vif-plugged-32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8361fb9d-c8c2-4f7e-b5d9-8575e25eef9d req-239b9a00-1eac-41a6-a6e7-2c0e1aa031c5 service nova] Acquiring lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8361fb9d-c8c2-4f7e-b5d9-8575e25eef9d req-239b9a00-1eac-41a6-a6e7-2c0e1aa031c5 service nova] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8361fb9d-c8c2-4f7e-b5d9-8575e25eef9d req-239b9a00-1eac-41a6-a6e7-2c0e1aa031c5 service nova] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:16 user nova-compute[82196]: DEBUG nova.compute.manager [req-8361fb9d-c8c2-4f7e-b5d9-8575e25eef9d req-239b9a00-1eac-41a6-a6e7-2c0e1aa031c5 service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] No waiting events found dispatching network-vif-plugged-32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:29:16 user nova-compute[82196]: WARNING nova.compute.manager [req-8361fb9d-c8c2-4f7e-b5d9-8575e25eef9d req-239b9a00-1eac-41a6-a6e7-2c0e1aa031c5 service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Received unexpected event network-vif-plugged-32cb9325-7443-4bd8-ad26-e54700ba6bf4 for instance with vm_state active and task_state None.
Apr 11 19:29:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:29:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:29:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:29:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:29:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:29:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:33 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:29:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:35 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:29:36 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:29:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:38 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:29:39 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:29:39 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:29:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:29:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:29:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:29:39 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:29:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Updating instance_info_cache with network_info: [{"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Received event network-changed-93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Refreshing instance network info cache due to event network-changed-93054605-985d-4168-9809-21feb31c1346. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] Acquiring lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] Acquired lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG nova.network.neutron [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Refreshing network info cache for port 93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:41 user nova-compute[82196]: INFO nova.compute.manager [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Terminating instance
Apr 11 19:29:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-89f93d6f-06a7-4ce2-ae43-8c6db29272cd req-fe60861c-fa66-473c-ad13-f1e8db46743e service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Received event network-vif-unplugged-93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89f93d6f-06a7-4ce2-ae43-8c6db29272cd req-fe60861c-fa66-473c-ad13-f1e8db46743e service nova] Acquiring lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89f93d6f-06a7-4ce2-ae43-8c6db29272cd req-fe60861c-fa66-473c-ad13-f1e8db46743e service nova] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89f93d6f-06a7-4ce2-ae43-8c6db29272cd req-fe60861c-fa66-473c-ad13-f1e8db46743e service nova] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-89f93d6f-06a7-4ce2-ae43-8c6db29272cd req-fe60861c-fa66-473c-ad13-f1e8db46743e service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] No waiting events found dispatching network-vif-unplugged-93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-89f93d6f-06a7-4ce2-ae43-8c6db29272cd req-fe60861c-fa66-473c-ad13-f1e8db46743e service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Received event network-vif-unplugged-93054605-985d-4168-9809-21feb31c1346 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:29:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG nova.network.neutron [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Updated VIF entry in instance network info cache for port 93054605-985d-4168-9809-21feb31c1346. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG nova.network.neutron [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Updating instance_info_cache with network_info: [{"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e01c2441-c224-47d1-8bda-7573ec01aedb req-b2098a0a-0064-49d7-9c28-cb5c4b8fe454 service nova] Releasing lock "refresh_cache-d424f88d-5f82-4cac-aa0f-4f99624bd3e7" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:42 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Instance destroyed successfully.
Apr 11 19:29:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lazy-loading 'resources' on Instance uuid d424f88d-5f82-4cac-aa0f-4f99624bd3e7 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1153080058',display_name='tempest-TestStampPattern-server-1153080058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1153080058',id=12,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk/F931FMuqnj9QLMI+pGBS0j8hrERQZ0hcpFPwqT+C/Srrx02ZenEuPQP/CTs/VLAlwECMwCuedYJB3t1d4C9VnWF3rrxqO6dqYPkLQMKZthDnoCY8H8zWO0Un/+Ismw==',key_name='tempest-TestStampPattern-1385471309',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:22:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bceca6e3506e43f68f9cf8d0b56d141b',ramdisk_id='',reservation_id='r-t10k1764',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-497408287',owner_user_name='tempest-TestStampPattern-497408287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:25:52Z,user_data=None,user_id='3a32a5d0547141a180f655e98567ed9a',uuid=d424f88d-5f82-4cac-aa0f-4f99624bd3e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Converting VIF {"id": "93054605-985d-4168-9809-21feb31c1346", "address": "fa:16:3e:84:48:64", "network": {"id": "1fb5e332-872b-4b2a-864b-eca71e3fb7cb", "bridge": "br-int", "label": "tempest-TestStampPattern-32357591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bceca6e3506e43f68f9cf8d0b56d141b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93054605-98", "ovs_interfaceid": "93054605-985d-4168-9809-21feb31c1346", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:48:64,bridge_name='br-int',has_traffic_filtering=True,id=93054605-985d-4168-9809-21feb31c1346,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93054605-98') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG os_vif [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:48:64,bridge_name='br-int',has_traffic_filtering=True,id=93054605-985d-4168-9809-21feb31c1346,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93054605-98') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93054605-98, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:29:42 user nova-compute[82196]: INFO os_vif [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:48:64,bridge_name='br-int',has_traffic_filtering=True,id=93054605-985d-4168-9809-21feb31c1346,network=Network(1fb5e332-872b-4b2a-864b-eca71e3fb7cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93054605-98')
Apr 11 19:29:42 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Deleting instance files /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7_del
Apr 11 19:29:42 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Deletion of /opt/stack/data/nova/instances/d424f88d-5f82-4cac-aa0f-4f99624bd3e7_del complete
Apr 11 19:29:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:42 user nova-compute[82196]: INFO nova.compute.manager [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 11 19:29:42 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:29:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:43 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:29:43 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7865MB free_disk=26.420047760009766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:29:43 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Took 0.55 seconds to deallocate network for instance.
Apr 11 19:29:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6802f099-9236-4c79-a892-2963f1b15b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 558100b9-f3ac-47c7-9260-b897b0cae55f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.300s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-0befb0df-2548-46e8-96e6-eef7c0051c50 req-90dc4759-c2b4-4977-9b5d-d53b9445f9ee service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Received event network-vif-deleted-93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:43 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Deleted allocations for instance d424f88d-5f82-4cac-aa0f-4f99624bd3e7
Apr 11 19:29:43 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-cf75-4eef-a033-43f9f8f1e6a6 tempest-TestStampPattern-497408287 tempest-TestStampPattern-497408287-project-member] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.289s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-59a73105-e7b1-42c7-949c-e622a7514c65 req-ba649d38-92e9-4643-9c7e-b620e016500a service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Received event network-vif-plugged-93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-59a73105-e7b1-42c7-949c-e622a7514c65 req-ba649d38-92e9-4643-9c7e-b620e016500a service nova] Acquiring lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-59a73105-e7b1-42c7-949c-e622a7514c65 req-ba649d38-92e9-4643-9c7e-b620e016500a service nova] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-59a73105-e7b1-42c7-949c-e622a7514c65 req-ba649d38-92e9-4643-9c7e-b620e016500a service nova] Lock "d424f88d-5f82-4cac-aa0f-4f99624bd3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-59a73105-e7b1-42c7-949c-e622a7514c65 req-ba649d38-92e9-4643-9c7e-b620e016500a service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] No waiting events found dispatching network-vif-plugged-93054605-985d-4168-9809-21feb31c1346 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:29:43 user nova-compute[82196]: WARNING nova.compute.manager [req-59a73105-e7b1-42c7-949c-e622a7514c65 req-ba649d38-92e9-4643-9c7e-b620e016500a service nova] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Received unexpected event network-vif-plugged-93054605-985d-4168-9809-21feb31c1346 for instance with vm_state deleted and task_state None.
Apr 11 19:29:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:29:50 user nova-compute[82196]: INFO nova.compute.claims [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Claim successful on node user
Apr 11 19:29:50 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:29:50 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:29:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG nova.policy [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:29:50 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Creating image(s)
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "/opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "/opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "/opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk 1073741824" returned: 0 in 0.068s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Checking if we can resize image /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:29:51 user nova-compute[82196]: INFO nova.compute.claims [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Claim successful on node user
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Cannot resize image /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'migration_context' on Instance uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Ensure instance console log exists: /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Successfully created port: 06fea704-e356-4605-811e-aac91617290e {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:29:51 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.policy [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:29:51 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Creating image(s)
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "/opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "/opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.030s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Successfully updated port: 06fea704-e356-4605-811e-aac91617290e {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquired lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-changed-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Refreshing instance network info cache due to event network-changed-06fea704-e356-4605-811e-aac91617290e. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] Acquiring lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk 1073741824" returned: 0 in 0.063s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Successfully created port: 1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Cannot resize image /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'migration_context' on Instance uuid 6f2616ce-4924-4b82-996a-2596ae8856a4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Ensure instance console log exists: /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updating instance_info_cache with network_info: [{"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Releasing lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Instance network_info: |[{"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] Acquired lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.network.neutron [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Refreshing network info cache for port 06fea704-e356-4605-811e-aac91617290e {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Start _get_guest_xml network_info=[{"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:29:52 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:29:52 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-706054067',display_name='tempest-ServerRescueNegativeTestJSON-server-706054067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-706054067',id=25,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8e3a291c54b49db8e12a88ba41865e3',ramdisk_id='',reservation_id='r-zcw3jruw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1429831687',owner_user_name='tempest-ServerRescueNegativeTestJSON-1429831687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:29:51Z,user_data=None,user_id='ba7f82b529e74d99838b6264b94d823b',uuid=267c17c1-f0b6-4e18-8c18-5e5bbe8a2251,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converting VIF {"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=06fea704-e356-4605-811e-aac91617290e,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fea704-e3') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'pci_devices' on Instance uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:29:52 user nova-compute[82196]:   <uuid>267c17c1-f0b6-4e18-8c18-5e5bbe8a2251</uuid>
Apr 11 19:29:52 user nova-compute[82196]:   <name>instance-00000019</name>
Apr 11 19:29:52 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:29:52 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:29:52 user nova-compute[82196]:   <metadata>
Apr 11 19:29:52 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:29:52 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:29:52 user nova-compute[82196]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-706054067</nova:name>
Apr 11 19:29:52 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:29:52</nova:creationTime>
Apr 11 19:29:52 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:29:52 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:29:52 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:29:52 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:29:52 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:29:52 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:29:52 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:29:52 user nova-compute[82196]:       <nova:owner>
Apr 11 19:29:52 user nova-compute[82196]:         <nova:user uuid="ba7f82b529e74d99838b6264b94d823b">tempest-ServerRescueNegativeTestJSON-1429831687-project-member</nova:user>
Apr 11 19:29:52 user nova-compute[82196]:         <nova:project uuid="b8e3a291c54b49db8e12a88ba41865e3">tempest-ServerRescueNegativeTestJSON-1429831687</nova:project>
Apr 11 19:29:52 user nova-compute[82196]:       </nova:owner>
Apr 11 19:29:52 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:29:52 user nova-compute[82196]:       <nova:ports>
Apr 11 19:29:52 user nova-compute[82196]:         <nova:port uuid="06fea704-e356-4605-811e-aac91617290e">
Apr 11 19:29:52 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 19:29:52 user nova-compute[82196]:         </nova:port>
Apr 11 19:29:52 user nova-compute[82196]:       </nova:ports>
Apr 11 19:29:52 user nova-compute[82196]:     </nova:instance>
Apr 11 19:29:52 user nova-compute[82196]:   </metadata>
Apr 11 19:29:52 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:29:52 user nova-compute[82196]:     <system>
Apr 11 19:29:52 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:29:52 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:29:52 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:29:52 user nova-compute[82196]:       <entry name="serial">267c17c1-f0b6-4e18-8c18-5e5bbe8a2251</entry>
Apr 11 19:29:52 user nova-compute[82196]:       <entry name="uuid">267c17c1-f0b6-4e18-8c18-5e5bbe8a2251</entry>
Apr 11 19:29:52 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:29:52 user nova-compute[82196]:     </system>
Apr 11 19:29:52 user nova-compute[82196]:   </sysinfo>
Apr 11 19:29:52 user nova-compute[82196]:   <os>
Apr 11 19:29:52 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:29:52 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:29:52 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:29:52 user nova-compute[82196]:   </os>
Apr 11 19:29:52 user nova-compute[82196]:   <features>
Apr 11 19:29:52 user nova-compute[82196]:     <acpi/>
Apr 11 19:29:52 user nova-compute[82196]:     <apic/>
Apr 11 19:29:52 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:29:52 user nova-compute[82196]:   </features>
Apr 11 19:29:52 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:29:52 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:29:52 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:29:52 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:29:52 user nova-compute[82196]:   </clock>
Apr 11 19:29:52 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:29:52 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:29:52 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:29:52 user nova-compute[82196]:   </cpu>
Apr 11 19:29:52 user nova-compute[82196]:   <devices>
Apr 11 19:29:52 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:29:52 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:29:52 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk"/>
Apr 11 19:29:52 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:29:52 user nova-compute[82196]:     </disk>
Apr 11 19:29:52 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:29:52 user nova-compute[82196]:       <mac address="fa:16:3e:0f:f8:7f"/>
Apr 11 19:29:52 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:29:52 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:29:52 user nova-compute[82196]:       <target dev="tap06fea704-e3"/>
Apr 11 19:29:52 user nova-compute[82196]:     </interface>
Apr 11 19:29:52 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:29:52 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/console.log" append="off"/>
Apr 11 19:29:52 user nova-compute[82196]:     </serial>
Apr 11 19:29:52 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:29:52 user nova-compute[82196]:     <video>
Apr 11 19:29:52 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:29:52 user nova-compute[82196]:     </video>
Apr 11 19:29:52 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:29:52 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:29:52 user nova-compute[82196]:     </rng>
Apr 11 19:29:52 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:29:52 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:29:52 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:29:52 user nova-compute[82196]:     </memballoon>
Apr 11 19:29:52 user nova-compute[82196]:   </devices>
Apr 11 19:29:52 user nova-compute[82196]: </domain>
Apr 11 19:29:52 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-706054067',display_name='tempest-ServerRescueNegativeTestJSON-server-706054067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-706054067',id=25,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8e3a291c54b49db8e12a88ba41865e3',ramdisk_id='',reservation_id='r-zcw3jruw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1429831687',owner_user_name='tempest-ServerRescueNegativeTestJSON-1429831687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:29:51Z,user_data=None,user_id='ba7f82b529e74d99838b6264b94d823b',uuid=267c17c1-f0b6-4e18-8c18-5e5bbe8a2251,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converting VIF {"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=06fea704-e356-4605-811e-aac91617290e,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fea704-e3') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG os_vif [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=06fea704-e356-4605-811e-aac91617290e,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fea704-e3') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06fea704-e3, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06fea704-e3, col_values=(('external_ids', {'iface-id': '06fea704-e356-4605-811e-aac91617290e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:f8:7f', 'vm-uuid': '267c17c1-f0b6-4e18-8c18-5e5bbe8a2251'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:52 user nova-compute[82196]: INFO os_vif [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=06fea704-e356-4605-811e-aac91617290e,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fea704-e3')
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:29:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No VIF found with MAC fa:16:3e:0f:f8:7f, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.network.neutron [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updated VIF entry in instance network info cache for port 06fea704-e356-4605-811e-aac91617290e. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.network.neutron [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updating instance_info_cache with network_info: [{"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Successfully updated port: 1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ecc7baf3-6b60-4ce9-9c4b-b92e516cbfa0 req-a58fd92d-2629-4d85-a7d3-54a8d9e49a55 service nova] Releasing lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquired lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-changed-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Refreshing instance network info cache due to event network-changed-1c929bc1-2708-4e38-80b3-354812ccb529. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] Acquiring lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Updating instance_info_cache with network_info: [{"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Releasing lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Instance network_info: |[{"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] Acquired lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.network.neutron [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Refreshing network info cache for port 1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Start _get_guest_xml network_info=[{"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:29:53 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:29:53 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1478797351',display_name='tempest-ServerRescueNegativeTestJSON-server-1478797351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1478797351',id=26,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8e3a291c54b49db8e12a88ba41865e3',ramdisk_id='',reservation_id='r-wmbysh2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1429831687',owner_user_name='tempest-ServerRescueNegativeTestJSON-1429831687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:29:52Z,user_data=None,user_id='ba7f82b529e74d99838b6264b94d823b',uuid=6f2616ce-4924-4b82-996a-2596ae8856a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converting VIF {"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:ad:54,bridge_name='br-int',has_traffic_filtering=True,id=1c929bc1-2708-4e38-80b3-354812ccb529,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c929bc1-27') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f2616ce-4924-4b82-996a-2596ae8856a4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:29:53 user nova-compute[82196]:   <uuid>6f2616ce-4924-4b82-996a-2596ae8856a4</uuid>
Apr 11 19:29:53 user nova-compute[82196]:   <name>instance-0000001a</name>
Apr 11 19:29:53 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:29:53 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:29:53 user nova-compute[82196]:   <metadata>
Apr 11 19:29:53 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:29:53 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:29:53 user nova-compute[82196]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1478797351</nova:name>
Apr 11 19:29:53 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:29:53</nova:creationTime>
Apr 11 19:29:53 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:29:53 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:29:53 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:29:53 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:29:53 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:29:53 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:29:53 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:29:53 user nova-compute[82196]:       <nova:owner>
Apr 11 19:29:53 user nova-compute[82196]:         <nova:user uuid="ba7f82b529e74d99838b6264b94d823b">tempest-ServerRescueNegativeTestJSON-1429831687-project-member</nova:user>
Apr 11 19:29:53 user nova-compute[82196]:         <nova:project uuid="b8e3a291c54b49db8e12a88ba41865e3">tempest-ServerRescueNegativeTestJSON-1429831687</nova:project>
Apr 11 19:29:53 user nova-compute[82196]:       </nova:owner>
Apr 11 19:29:53 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:29:53 user nova-compute[82196]:       <nova:ports>
Apr 11 19:29:53 user nova-compute[82196]:         <nova:port uuid="1c929bc1-2708-4e38-80b3-354812ccb529">
Apr 11 19:29:53 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 19:29:53 user nova-compute[82196]:         </nova:port>
Apr 11 19:29:53 user nova-compute[82196]:       </nova:ports>
Apr 11 19:29:53 user nova-compute[82196]:     </nova:instance>
Apr 11 19:29:53 user nova-compute[82196]:   </metadata>
Apr 11 19:29:53 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:29:53 user nova-compute[82196]:     <system>
Apr 11 19:29:53 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:29:53 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:29:53 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:29:53 user nova-compute[82196]:       <entry name="serial">6f2616ce-4924-4b82-996a-2596ae8856a4</entry>
Apr 11 19:29:53 user nova-compute[82196]:       <entry name="uuid">6f2616ce-4924-4b82-996a-2596ae8856a4</entry>
Apr 11 19:29:53 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:29:53 user nova-compute[82196]:     </system>
Apr 11 19:29:53 user nova-compute[82196]:   </sysinfo>
Apr 11 19:29:53 user nova-compute[82196]:   <os>
Apr 11 19:29:53 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:29:53 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:29:53 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:29:53 user nova-compute[82196]:   </os>
Apr 11 19:29:53 user nova-compute[82196]:   <features>
Apr 11 19:29:53 user nova-compute[82196]:     <acpi/>
Apr 11 19:29:53 user nova-compute[82196]:     <apic/>
Apr 11 19:29:53 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:29:53 user nova-compute[82196]:   </features>
Apr 11 19:29:53 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:29:53 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:29:53 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:29:53 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:29:53 user nova-compute[82196]:   </clock>
Apr 11 19:29:53 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:29:53 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:29:53 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:29:53 user nova-compute[82196]:   </cpu>
Apr 11 19:29:53 user nova-compute[82196]:   <devices>
Apr 11 19:29:53 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:29:53 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:29:53 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk"/>
Apr 11 19:29:53 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:29:53 user nova-compute[82196]:     </disk>
Apr 11 19:29:53 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:29:53 user nova-compute[82196]:       <mac address="fa:16:3e:d5:ad:54"/>
Apr 11 19:29:53 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:29:53 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:29:53 user nova-compute[82196]:       <target dev="tap1c929bc1-27"/>
Apr 11 19:29:53 user nova-compute[82196]:     </interface>
Apr 11 19:29:53 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:29:53 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/console.log" append="off"/>
Apr 11 19:29:53 user nova-compute[82196]:     </serial>
Apr 11 19:29:53 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:29:53 user nova-compute[82196]:     <video>
Apr 11 19:29:53 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:29:53 user nova-compute[82196]:     </video>
Apr 11 19:29:53 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:29:53 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:29:53 user nova-compute[82196]:     </rng>
Apr 11 19:29:53 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:29:53 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:29:53 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:29:53 user nova-compute[82196]:     </memballoon>
Apr 11 19:29:53 user nova-compute[82196]:   </devices>
Apr 11 19:29:53 user nova-compute[82196]: </domain>
Apr 11 19:29:53 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1478797351',display_name='tempest-ServerRescueNegativeTestJSON-server-1478797351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1478797351',id=26,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8e3a291c54b49db8e12a88ba41865e3',ramdisk_id='',reservation_id='r-wmbysh2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1429831687',owner_user_name='tempest-ServerRescueNegativeTestJSON-1429831687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:29:52Z,user_data=None,user_id='ba7f82b529e74d99838b6264b94d823b',uuid=6f2616ce-4924-4b82-996a-2596ae8856a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converting VIF {"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:ad:54,bridge_name='br-int',has_traffic_filtering=True,id=1c929bc1-2708-4e38-80b3-354812ccb529,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c929bc1-27') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG os_vif [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:ad:54,bridge_name='br-int',has_traffic_filtering=True,id=1c929bc1-2708-4e38-80b3-354812ccb529,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c929bc1-27') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c929bc1-27, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c929bc1-27, col_values=(('external_ids', {'iface-id': '1c929bc1-2708-4e38-80b3-354812ccb529', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:ad:54', 'vm-uuid': '6f2616ce-4924-4b82-996a-2596ae8856a4'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:53 user nova-compute[82196]: INFO os_vif [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:ad:54,bridge_name='br-int',has_traffic_filtering=True,id=1c929bc1-2708-4e38-80b3-354812ccb529,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c929bc1-27')
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:29:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No VIF found with MAC fa:16:3e:d5:ad:54, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:29:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Updated VIF entry in instance network info cache for port 1c929bc1-2708-4e38-80b3-354812ccb529. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:29:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Updating instance_info_cache with network_info: [{"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:29:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5c53355f-52bc-4f8e-9b74-1e10eb524b41 req-7660290b-ecec-4e58-989d-55d577b95e4b service nova] Releasing lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:29:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:29:55 user nova-compute[82196]: WARNING nova.compute.manager [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received unexpected event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e for instance with vm_state building and task_state spawning.
Apr 11 19:29:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:29:55 user nova-compute[82196]: WARNING nova.compute.manager [req-44764536-ec8c-4131-a6a3-940f27943e00 req-435614ff-5bc5-49db-aa8f-a24910227bdc service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received unexpected event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e for instance with vm_state building and task_state spawning.
Apr 11 19:29:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-def02d6f-58c8-4c57-947a-90457b464179 req-a543143a-c0db-4d64-8150-03ae0fbb504d service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-def02d6f-58c8-4c57-947a-90457b464179 req-a543143a-c0db-4d64-8150-03ae0fbb504d service nova] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-def02d6f-58c8-4c57-947a-90457b464179 req-a543143a-c0db-4d64-8150-03ae0fbb504d service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-def02d6f-58c8-4c57-947a-90457b464179 req-a543143a-c0db-4d64-8150-03ae0fbb504d service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-def02d6f-58c8-4c57-947a-90457b464179 req-a543143a-c0db-4d64-8150-03ae0fbb504d service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] No waiting events found dispatching network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:29:56 user nova-compute[82196]: WARNING nova.compute.manager [req-def02d6f-58c8-4c57-947a-90457b464179 req-a543143a-c0db-4d64-8150-03ae0fbb504d service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received unexpected event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 for instance with vm_state building and task_state spawning.
Apr 11 19:29:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241382.311995, d424f88d-5f82-4cac-aa0f-4f99624bd3e7 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] VM Stopped (Lifecycle Event)
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e5ce3cd6-2115-46c1-b467-d35f751fd7ee None None] [instance: d424f88d-5f82-4cac-aa0f-4f99624bd3e7] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241397.7329524, 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] VM Resumed (Lifecycle Event)
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Instance spawned successfully.
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241397.7342787, 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] VM Started (Lifecycle Event)
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241397.8394117, 6f2616ce-4924-4b82-996a-2596ae8856a4 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] VM Resumed (Lifecycle Event)
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Instance spawned successfully.
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.compute.manager [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Took 7.17 seconds to spawn the instance on the hypervisor.
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241397.8434458, 6f2616ce-4924-4b82-996a-2596ae8856a4 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] VM Started (Lifecycle Event)
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.compute.manager [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Took 5.98 seconds to spawn the instance on the hypervisor.
Apr 11 19:29:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.compute.manager [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Took 7.87 seconds to build instance.
Apr 11 19:29:57 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:29:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4dfa21dc-0845-4206-b4b4-983b87e3fbc0 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.970s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:58 user nova-compute[82196]: INFO nova.compute.manager [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Took 6.91 seconds to build instance.
Apr 11 19:29:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f58cfbb-4553-4dfb-8f50-85214e9bbe88 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.038s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-6531260b-3f8f-4751-bdd1-30080e77fbdf req-4e5b64b7-828d-432d-808f-1ac9fcc6a710 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:29:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6531260b-3f8f-4751-bdd1-30080e77fbdf req-4e5b64b7-828d-432d-808f-1ac9fcc6a710 service nova] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:29:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6531260b-3f8f-4751-bdd1-30080e77fbdf req-4e5b64b7-828d-432d-808f-1ac9fcc6a710 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:29:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6531260b-3f8f-4751-bdd1-30080e77fbdf req-4e5b64b7-828d-432d-808f-1ac9fcc6a710 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:29:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-6531260b-3f8f-4751-bdd1-30080e77fbdf req-4e5b64b7-828d-432d-808f-1ac9fcc6a710 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] No waiting events found dispatching network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:29:58 user nova-compute[82196]: WARNING nova.compute.manager [req-6531260b-3f8f-4751-bdd1-30080e77fbdf req-4e5b64b7-828d-432d-808f-1ac9fcc6a710 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received unexpected event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 for instance with vm_state active and task_state None.
Apr 11 19:29:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:29:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:08 user nova-compute[82196]: DEBUG nova.compute.manager [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received event network-changed-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:08 user nova-compute[82196]: DEBUG nova.compute.manager [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Refreshing instance network info cache due to event network-changed-4f568bd5-7271-434e-a30e-beb13759e1f1. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:30:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] Acquiring lock "refresh_cache-558100b9-f3ac-47c7-9260-b897b0cae55f" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:30:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] Acquired lock "refresh_cache-558100b9-f3ac-47c7-9260-b897b0cae55f" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:30:08 user nova-compute[82196]: DEBUG nova.network.neutron [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Refreshing network info cache for port 4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:30:09 user nova-compute[82196]: DEBUG nova.network.neutron [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Updated VIF entry in instance network info cache for port 4f568bd5-7271-434e-a30e-beb13759e1f1. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:30:09 user nova-compute[82196]: DEBUG nova.network.neutron [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Updating instance_info_cache with network_info: [{"id": "4f568bd5-7271-434e-a30e-beb13759e1f1", "address": "fa:16:3e:93:57:af", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f568bd5-72", "ovs_interfaceid": "4f568bd5-7271-434e-a30e-beb13759e1f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:30:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-78b60368-e3c9-489e-b5ee-3d940344127d req-ad101cbe-a08d-46c9-a166-6bb3df117c2e service nova] Releasing lock "refresh_cache-558100b9-f3ac-47c7-9260-b897b0cae55f" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:30:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "558100b9-f3ac-47c7-9260-b897b0cae55f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG nova.objects.instance [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'flavor' on Instance uuid 558100b9-f3ac-47c7-9260-b897b0cae55f {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "558100b9-f3ac-47c7-9260-b897b0cae55f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:10 user nova-compute[82196]: INFO nova.compute.manager [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Attaching volume ac30dce5-e2c0-4981-af4a-10be9d923877 to /dev/vdb
Apr 11 19:30:10 user nova-compute[82196]: DEBUG os_brick.utils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1ee75d-6073-4f0e-a107-d63284abebec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f8efdb-4739-42d2-91d6-eb21b7973a56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ae2443-77fc-4e99-8ade-eb68e55c7ddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3860513-9870-4c56-a5cb-7ea2405e0342]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:30:10 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:30:10 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a68969-1627-4638-b90c-35b2e254bcaa]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG os_brick.utils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:10 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Updating existing volume attachment record: 8a8619ca-e148-4ca7-9f65-5499128382cd {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:30:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIkUmNdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:15 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:15 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:15 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8333ee73-94fe-4b1c-87cb-145f42e35f00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:30:15 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f598bee-a176-4df0-8373-dc9445cca48b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877] added
Apr 11 19:30:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6a060-0131-43df-8291-3d4d8f7f8b18]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[709eac8a-879d-4d3d-bd0e-b921157740d6]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIkUmNdA {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIkUmNdA" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7f39d5-caca-474e-bfa3-88e59c37c528]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QIkUmNdA'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2b9214-8e56-41d8-a69f-451f070e4fbd]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3850a2b-59fa-40c5-bb0f-83d2a17ef5c9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:15 user nova-compute[82196]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:30:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:15 user nova-compute[82196]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:30:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40f3485-8df0-4d80-95ca-a0bd088b313c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877, portal: 172.16.0.220,3260]
Apr 11 19:30:15 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877, portal: 172.16.0.220,3260] successful.
Apr 11 19:30:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f72f72-0b85-4f94-84cb-3550b3d670ec]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc47a700-1fe2-47fb-80fa-1508fb2c9d63]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:15 user nova-compute[82196]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:30:15 user nova-compute[82196]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 (non-flash)
Apr 11 19:30:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:15 user nova-compute[82196]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:30:15 user nova-compute[82196]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 (non-flash)
Apr 11 19:30:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ec96d3-f456-4e23-be78-0dcbb5399182]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:30:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:30:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIkUmNdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:30:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26339623131666262', 'path': '/dev/sdd'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339623131666262', 'path': '/dev/sdd'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:30:16 user nova-compute[82196]: DEBUG nova.objects.instance [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'flavor' on Instance uuid 558100b9-f3ac-47c7-9260-b897b0cae55f {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:30:16 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:30:16 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:30:16 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:30:16 user nova-compute[82196]:   <serial>ac30dce5-e2c0-4981-af4a-10be9d923877</serial>
Apr 11 19:30:16 user nova-compute[82196]: </disk>
Apr 11 19:30:16 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:30:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:30:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:30:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No VIF found with MAC fa:16:3e:93:57:af, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:30:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5f8c97af-4bcb-4f0e-8f48-c6b945df7d1b tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.249s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:17 user nova-compute[82196]: INFO nova.compute.manager [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Terminating instance
Apr 11 19:30:17 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "558100b9-f3ac-47c7-9260-b897b0cae55f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:17 user nova-compute[82196]: INFO nova.compute.manager [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Detaching volume ac30dce5-e2c0-4981-af4a-10be9d923877
Apr 11 19:30:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:17 user nova-compute[82196]: INFO nova.virt.block_device [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Attempting to driver detach volume ac30dce5-e2c0-4981-af4a-10be9d923877 from mountpoint /dev/vdb
Apr 11 19:30:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Attempting to detach device vdb from instance 558100b9-f3ac-47c7-9260-b897b0cae55f from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:30:17 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:30:17 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:30:17 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:30:17 user nova-compute[82196]:   <serial>ac30dce5-e2c0-4981-af4a-10be9d923877</serial>
Apr 11 19:30:17 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:30:17 user nova-compute[82196]: </disk>
Apr 11 19:30:17 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:30:17 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully detached device vdb from instance 558100b9-f3ac-47c7-9260-b897b0cae55f from the persistent domain config.
Apr 11 19:30:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 558100b9-f3ac-47c7-9260-b897b0cae55f from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:30:17 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:30:17 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:30:17 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:30:17 user nova-compute[82196]:   <serial>ac30dce5-e2c0-4981-af4a-10be9d923877</serial>
Apr 11 19:30:17 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:30:17 user nova-compute[82196]: </disk>
Apr 11 19:30:17 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-84e556c4-a097-4dd7-8d6f-e6c69d5a17f9 req-fa06b8e6-cba3-40ad-a193-5f042703b0a5 service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Received event network-vif-unplugged-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-84e556c4-a097-4dd7-8d6f-e6c69d5a17f9 req-fa06b8e6-cba3-40ad-a193-5f042703b0a5 service nova] Acquiring lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-84e556c4-a097-4dd7-8d6f-e6c69d5a17f9 req-fa06b8e6-cba3-40ad-a193-5f042703b0a5 service nova] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-84e556c4-a097-4dd7-8d6f-e6c69d5a17f9 req-fa06b8e6-cba3-40ad-a193-5f042703b0a5 service nova] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-84e556c4-a097-4dd7-8d6f-e6c69d5a17f9 req-fa06b8e6-cba3-40ad-a193-5f042703b0a5 service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] No waiting events found dispatching network-vif-unplugged-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-84e556c4-a097-4dd7-8d6f-e6c69d5a17f9 req-fa06b8e6-cba3-40ad-a193-5f042703b0a5 service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Received event network-vif-unplugged-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:30:18 user nova-compute[82196]: INFO nova.compute.manager [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Rescuing
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquired lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241418.218595, 558100b9-f3ac-47c7-9260-b897b0cae55f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 558100b9-f3ac-47c7-9260-b897b0cae55f {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:30:18 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully detached device vdb from instance 558100b9-f3ac-47c7-9260-b897b0cae55f from the live domain config.
Apr 11 19:30:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIkUmNdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:18 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[086c0eda-2ae5-46de-af73-5e469cb309ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:30:18 user nova-compute[82196]: No targets found.
Apr 11 19:30:18 user nova-compute[82196]: iSNS:
Apr 11 19:30:18 user nova-compute[82196]: No targets found.
Apr 11 19:30:18 user nova-compute[82196]: STATIC:
Apr 11 19:30:18 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877
Apr 11 19:30:18 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:30:18 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:30:18 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:30:18 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:30:18 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:30:18 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e
Apr 11 19:30:18 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:30:18 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:30:18 user nova-compute[82196]: FIRMWARE:
Apr 11 19:30:18 user nova-compute[82196]: No targets found.
Apr 11 19:30:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:30:18 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:30:18 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[445d5802-deee-4d4b-b9a8-100fc926df00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7b783d-b0a1-47de-a052-5a556eb8ff80]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:18 user nova-compute[82196]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:30:18 user nova-compute[82196]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 (non-flash)
Apr 11 19:30:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:18 user nova-compute[82196]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:30:18 user nova-compute[82196]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 (non-flash)
Apr 11 19:30:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9281bf2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877'): ({'sdd'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Removing single pathed devices sdd {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d792a9-152e-476b-a652-ac7ded77df20]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56a4956-3f52-4541-86ef-41e00df122a4]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flushing IO for device /dev/sdd {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b759000-be72-4bae-bd58-03d71b5ef07a]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8999bc-3f77-48d4-b1c1-80190ddd1ae3]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c52f325-93cf-4198-a3e0-5506ccf4b9c6]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[833abac8-b302-4e26-b41d-cacbc197f7da]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877, portal: 172.16.0.220,3260]
Apr 11 19:30:18 user nova-compute[82196]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877, portal: 172.16.0.220,3260] successful.
Apr 11 19:30:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Updating instance_info_cache with network_info: [{"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac30dce5-e2c0-4981-af4a-10be9d923877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Releasing lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3ebfde-c7a3-408a-b6ba-fb86e56fce9c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] <== disconnect_volume: return (334ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:30:18 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Instance destroyed successfully.
Apr 11 19:30:18 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lazy-loading 'resources' on Instance uuid fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1297415435',display_name='tempest-ServersNegativeTestJSON-server-1297415435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1297415435',id=1,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:21:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d5d7769df1e4974b295cb30407151dd',ramdisk_id='',reservation_id='r-tdu8k0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1311045721',owner_user_name='tempest-ServersNegativeTestJSON-1311045721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:21:54Z,user_data=None,user_id='2f44dfa2528b4540a81f4eb7c3f3f2f5',uuid=fc48e37f-8c00-4e48-bea3-f1c2e54d78b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "address": "fa:16:3e:c2:7d:b5", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4beb6cf-d1", "ovs_interfaceid": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Converting VIF {"id": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "address": "fa:16:3e:c2:7d:b5", "network": {"id": "b29e55eb-c801-47f0-8cb7-be11e1471261", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1540255016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5d7769df1e4974b295cb30407151dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4beb6cf-d1", "ovs_interfaceid": "b4beb6cf-d11a-487e-b95d-6adec8a8ee4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:7d:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4beb6cf-d11a-487e-b95d-6adec8a8ee4d,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4beb6cf-d1') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG os_vif [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:7d:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4beb6cf-d11a-487e-b95d-6adec8a8ee4d,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4beb6cf-d1') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4beb6cf-d1, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:30:18 user nova-compute[82196]: INFO os_vif [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:7d:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4beb6cf-d11a-487e-b95d-6adec8a8ee4d,network=Network(b29e55eb-c801-47f0-8cb7-be11e1471261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4beb6cf-d1')
Apr 11 19:30:18 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Deleting instance files /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8_del
Apr 11 19:30:18 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Deletion of /opt/stack/data/nova/instances/fc48e37f-8c00-4e48-bea3-f1c2e54d78b8_del complete
Apr 11 19:30:18 user nova-compute[82196]: INFO nova.compute.manager [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 11 19:30:18 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:30:19 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Took 0.52 seconds to deallocate network for instance.
Apr 11 19:30:19 user nova-compute[82196]: DEBUG nova.compute.manager [req-d78bbec2-5470-436a-b2d0-f62731ed3822 req-ea0f8e9a-0586-4959-a93b-03fe64400cf6 service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Received event network-vif-deleted-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG nova.objects.instance [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'flavor' on Instance uuid 558100b9-f3ac-47c7-9260-b897b0cae55f {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d46c76b2-a655-410c-85e1-13d66098a91f tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.806s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:19 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Instance destroyed successfully.
Apr 11 19:30:19 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Attempting a stable device rescue
Apr 11 19:30:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82196) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Instance directory exists: not creating {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 19:30:19 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Creating image(s)
Apr 11 19:30:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "/opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "/opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "/opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'trusted_certs' on Instance uuid 864fcd9b-8e5b-4de8-a2e6-292a8907a834 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "976fa510ed0176378abde9a45fafd25889319de1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "976fa510ed0176378abde9a45fafd25889319de1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:30:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:19 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Deleted allocations for instance fc48e37f-8c00-4e48-bea3-f1c2e54d78b8
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1.part --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Received event network-vif-plugged-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Acquiring lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] No waiting events found dispatching network-vif-plugged-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:20 user nova-compute[82196]: WARNING nova.compute.manager [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Received unexpected event network-vif-plugged-b4beb6cf-d11a-487e-b95d-6adec8a8ee4d for instance with vm_state deleted and task_state None.
Apr 11 19:30:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-unplugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] No waiting events found dispatching network-vif-unplugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:20 user nova-compute[82196]: WARNING nova.compute.manager [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received unexpected event network-vif-unplugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance with vm_state active and task_state rescuing.
Apr 11 19:30:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] No waiting events found dispatching network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:20 user nova-compute[82196]: WARNING nova.compute.manager [req-d2842b6f-f4c5-4f6a-a1df-dba04de3288f req-013bb8d8-3501-45e1-ac20-624d86c99373 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received unexpected event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance with vm_state active and task_state rescuing.
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1a402cae-7949-44ce-8b1e-8f7bae49abaa tempest-ServersNegativeTestJSON-1311045721 tempest-ServersNegativeTestJSON-1311045721-project-member] Lock "fc48e37f-8c00-4e48-bea3-f1c2e54d78b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.071s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1.part --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG nova.virt.images [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] fd4277e1-9257-4e4e-8dd2-0ed12c759968 was qcow2, converting to raw {{(pid=82196) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:30:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1.part /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1.converted {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1.part /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1.converted" returned: 0 in 0.857s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1.converted --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "976fa510ed0176378abde9a45fafd25889319de1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.068s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "976fa510ed0176378abde9a45fafd25889319de1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "976fa510ed0176378abde9a45fafd25889319de1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1 --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1,backing_fmt=raw /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.rescue {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1,backing_fmt=raw /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.rescue" returned: 0 in 0.050s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "976fa510ed0176378abde9a45fafd25889319de1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'migration_context' on Instance uuid 864fcd9b-8e5b-4de8-a2e6-292a8907a834 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Start _get_guest_xml network_info=[{"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "vif_mac": "fa:16:3e:db:2d:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fd4277e1-9257-4e4e-8dd2-0ed12c759968', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBQxmzcq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '864fcd9b-8e5b-4de8-a2e6-292a8907a834', 'attached_at': '', 'detached_at': '', 'volume_id': '7c16a921-5f10-4a87-bd7c-2be0654eea21', 'serial': '7c16a921-5f10-4a87-bd7c-2be0654eea21'}, 'attachment_id': '934da42e-d955-4c25-b755-efbd83bed0d8', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'resources' on Instance uuid 864fcd9b-8e5b-4de8-a2e6-292a8907a834 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'numa_topology' on Instance uuid 864fcd9b-8e5b-4de8-a2e6-292a8907a834 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:21 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:30:21 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'vcpu_model' on Instance uuid 864fcd9b-8e5b-4de8-a2e6-292a8907a834 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBQxmzcq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:21 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:30:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:21 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:30:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:21 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c0e95c-48aa-490e-b4be-4e1404bcad44]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = FBQxmzcq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 19:30:21 user nova-compute[82196]: node.name = iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:30:21 user nova-compute[82196]: node.tpgt = -1
Apr 11 19:30:21 user nova-compute[82196]: node.startup = automatic
Apr 11 19:30:21 user nova-compute[82196]: node.leading_login = No
Apr 11 19:30:21 user nova-compute[82196]: iface.iscsi_ifacename = default
Apr 11 19:30:21 user nova-compute[82196]: iface.net_ifacename = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.ipaddress = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.prefix_len = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.hwaddress = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.transport_name = tcp
Apr 11 19:30:21 user nova-compute[82196]: iface.initiatorname = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.state = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.vlan_id = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.vlan_priority = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.vlan_state = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.iface_num = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.mtu = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.port = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.bootproto = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.subnet_mask = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.gateway = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.dhcp_alt_client_id = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.dhcp_dns = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.dhcp_learn_iqn = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.dhcp_vendor_id_state = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.dhcp_vendor_id = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.dhcp_slp_da = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.fragmentation = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.gratuitous_arp = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.incoming_forwarding = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.tos_state = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.tos = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.ttl = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.delayed_ack = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.tcp_nagle = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.tcp_wsf_state = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.tcp_wsf = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.tcp_timer_scale = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.tcp_timestamp = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.redirect = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.def_task_mgmt_timeout = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.header_digest = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.data_digest = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.immediate_data = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.initial_r2t = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.data_seq_inorder = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.data_pdu_inorder = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.erl = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.max_receive_data_len = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.first_burst_len = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.max_outstanding_r2t = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.max_burst_len = 0
Apr 11 19:30:21 user nova-compute[82196]: iface.chap_auth = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.bidi_chap = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.strict_login_compliance = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.discovery_auth = <empty>
Apr 11 19:30:21 user nova-compute[82196]: iface.discovery_logout = <empty>
Apr 11 19:30:21 user nova-compute[82196]: node.discovery_address = <empty>
Apr 11 19:30:21 user nova-compute[82196]: node.discovery_port = 0
Apr 11 19:30:21 user nova-compute[82196]: node.discovery_type = static
Apr 11 19:30:21 user nova-compute[82196]: node.session.initial_cmdsn = 0
Apr 11 19:30:21 user nova-compute[82196]: node.session.initial_login_retry_max = 8
Apr 11 19:30:21 user nova-compute[82196]: node.session.xmit_thread_priority = -20
Apr 11 19:30:21 user nova-compute[82196]: node.session.cmds_max = 128
Apr 11 19:30:21 user nova-compute[82196]: node.session.queue_depth = 32
Apr 11 19:30:21 user nova-compute[82196]: node.session.nr_sessions = 1
Apr 11 19:30:21 user nova-compute[82196]: node.session.auth.authmethod = CHAP
Apr 11 19:30:21 user nova-compute[82196]: node.session.auth.username = FBQxmzcq
Apr 11 19:30:21 user nova-compute[82196]: node.session.auth.password = ***
Apr 11 19:30:21 user nova-compute[82196]: node.session.auth.username_in = <empty>
Apr 11 19:30:21 user nova-compute[82196]: node.session.auth.password_in = <empty>
Apr 11 19:30:21 user nova-compute[82196]: node.session.auth.chap_algs = MD5
Apr 11 19:30:21 user nova-compute[82196]: node.session.timeo.replacement_timeout = 120
Apr 11 19:30:21 user nova-compute[82196]: node.session.err_timeo.abort_timeout = 15
Apr 11 19:30:21 user nova-compute[82196]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 19:30:21 user nova-compute[82196]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 19:30:21 user nova-compute[82196]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 19:30:21 user nova-compute[82196]: node.session.iscsi.FastAbort = Yes
Apr 11 19:30:21 user nova-compute[82196]: node.session.iscsi.InitialR2T = No
Apr 11 19:30:21 user nova-compute[82196]: node.session.iscsi.ImmediateData = Yes
Apr 11 19:30:21 user nova-compute[82196]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 19:30:21 user nova-compute[82196]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 19:30:21 user nova-compute[82196]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 19:30:21 user nova-compute[82196]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 19:30:21 user nova-compute[82196]: node.session.iscsi.MaxConnections = 1
Apr 11 19:30:21 user nova-compute[82196]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 19:30:21 user nova-compute[82196]: node.session.iscsi.ERL = 0
Apr 11 19:30:21 user nova-compute[82196]: node.session.scan = manual
Apr 11 19:30:21 user nova-compute[82196]: node.session.reopen_max = 0
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].address = 172.16.0.220
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].port = 3260
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].startup = manual
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].tcp.window_size = 524288
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].tcp.type_of_service = 0
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].timeo.logout_timeout = 15
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].timeo.login_timeout = 15
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].timeo.auth_timeout = 45
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].iscsi.DataDigest = None
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].iscsi.IFMarker = No
Apr 11 19:30:21 user nova-compute[82196]: node.conn[0].iscsi.OFMarker = No
Apr 11 19:30:21 user nova-compute[82196]: # END RECORD
Apr 11 19:30:21 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf9e835-8d2c-4343-93c2-c0cb1ce01e1e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3457533-8535-4517-bf3d-b9d05cfff95e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBQxmzcq {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBQxmzcq" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9739f28-422a-4878-9dd0-4e74f6d3be5b]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FBQxmzcq'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[adba09dd-17ad-4904-8b74-1dccde2e50ea]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b91128f-f126-4535-aabc-ea64b9245e0b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:22 user nova-compute[82196]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:30:22 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:22 user nova-compute[82196]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:30:22 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.147s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] HCTL ('33', '0', '0', 0) found on session 21 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1a3cdf-1d9d-4219-a68a-51db32118d1f]: (4, ('0 0 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Searching for a device in session 21 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBQxmzcq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '23733383263643261', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733383263643261', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "720c683f-c03a-444c-92a8-daf97c9f524b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:22 user nova-compute[82196]: INFO nova.compute.manager [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Unshelving
Apr 11 19:30:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2079796435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2079796435',id=23,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:28:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-v6h0cyai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:28:44Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=864fcd9b-8e5b-4de8-a2e6-292a8907a834,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "vif_mac": "fa:16:3e:db:2d:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "vif_mac": "fa:16:3e:db:2d:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:2d:10,bridge_name='br-int',has_traffic_filtering=True,id=60f272b0-f7d2-408b-b99b-9bcfcd3f23ff,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f272b0-f7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'pci_devices' on Instance uuid 864fcd9b-8e5b-4de8-a2e6-292a8907a834 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:30:22 user nova-compute[82196]:   <uuid>864fcd9b-8e5b-4de8-a2e6-292a8907a834</uuid>
Apr 11 19:30:22 user nova-compute[82196]:   <name>instance-00000017</name>
Apr 11 19:30:22 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:30:22 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:30:22 user nova-compute[82196]:   <metadata>
Apr 11 19:30:22 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:30:22 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:30:22 user nova-compute[82196]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2079796435</nova:name>
Apr 11 19:30:22 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:30:21</nova:creationTime>
Apr 11 19:30:22 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:30:22 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:30:22 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:30:22 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:30:22 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:30:22 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:30:22 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:30:22 user nova-compute[82196]:       <nova:owner>
Apr 11 19:30:22 user nova-compute[82196]:         <nova:user uuid="1b3adca432b04d70818a51d1366f5c6d">tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member</nova:user>
Apr 11 19:30:22 user nova-compute[82196]:         <nova:project uuid="eb91586feb3f4a4c84fa8c2183baaf8c">tempest-ServerBootFromVolumeStableRescueTest-863156619</nova:project>
Apr 11 19:30:22 user nova-compute[82196]:       </nova:owner>
Apr 11 19:30:22 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:30:22 user nova-compute[82196]:       <nova:ports>
Apr 11 19:30:22 user nova-compute[82196]:         <nova:port uuid="60f272b0-f7d2-408b-b99b-9bcfcd3f23ff">
Apr 11 19:30:22 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 19:30:22 user nova-compute[82196]:         </nova:port>
Apr 11 19:30:22 user nova-compute[82196]:       </nova:ports>
Apr 11 19:30:22 user nova-compute[82196]:     </nova:instance>
Apr 11 19:30:22 user nova-compute[82196]:   </metadata>
Apr 11 19:30:22 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:30:22 user nova-compute[82196]:     <system>
Apr 11 19:30:22 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:30:22 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:30:22 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:30:22 user nova-compute[82196]:       <entry name="serial">864fcd9b-8e5b-4de8-a2e6-292a8907a834</entry>
Apr 11 19:30:22 user nova-compute[82196]:       <entry name="uuid">864fcd9b-8e5b-4de8-a2e6-292a8907a834</entry>
Apr 11 19:30:22 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:30:22 user nova-compute[82196]:     </system>
Apr 11 19:30:22 user nova-compute[82196]:   </sysinfo>
Apr 11 19:30:22 user nova-compute[82196]:   <os>
Apr 11 19:30:22 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:30:22 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:30:22 user nova-compute[82196]:   </os>
Apr 11 19:30:22 user nova-compute[82196]:   <features>
Apr 11 19:30:22 user nova-compute[82196]:     <acpi/>
Apr 11 19:30:22 user nova-compute[82196]:     <apic/>
Apr 11 19:30:22 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:30:22 user nova-compute[82196]:   </features>
Apr 11 19:30:22 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:30:22 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:30:22 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:30:22 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:30:22 user nova-compute[82196]:   </clock>
Apr 11 19:30:22 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:30:22 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:30:22 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:30:22 user nova-compute[82196]:   </cpu>
Apr 11 19:30:22 user nova-compute[82196]:   <devices>
Apr 11 19:30:22 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:30:22 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:30:22 user nova-compute[82196]:       <source dev="/dev/sdb"/>
Apr 11 19:30:22 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:30:22 user nova-compute[82196]:       <serial>7c16a921-5f10-4a87-bd7c-2be0654eea21</serial>
Apr 11 19:30:22 user nova-compute[82196]:     </disk>
Apr 11 19:30:22 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:30:22 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:30:22 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.rescue"/>
Apr 11 19:30:22 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:30:22 user nova-compute[82196]:       <boot order="1"/>
Apr 11 19:30:22 user nova-compute[82196]:     </disk>
Apr 11 19:30:22 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:30:22 user nova-compute[82196]:       <mac address="fa:16:3e:db:2d:10"/>
Apr 11 19:30:22 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:30:22 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:30:22 user nova-compute[82196]:       <target dev="tap60f272b0-f7"/>
Apr 11 19:30:22 user nova-compute[82196]:     </interface>
Apr 11 19:30:22 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:30:22 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/console.log" append="off"/>
Apr 11 19:30:22 user nova-compute[82196]:     </serial>
Apr 11 19:30:22 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:30:22 user nova-compute[82196]:     <video>
Apr 11 19:30:22 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:30:22 user nova-compute[82196]:     </video>
Apr 11 19:30:22 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:30:22 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:30:22 user nova-compute[82196]:     </rng>
Apr 11 19:30:22 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:30:22 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:30:22 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:30:22 user nova-compute[82196]:     </memballoon>
Apr 11 19:30:22 user nova-compute[82196]:   </devices>
Apr 11 19:30:22 user nova-compute[82196]: </domain>
Apr 11 19:30:22 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:30:22 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Instance destroyed successfully.
Apr 11 19:30:22 user nova-compute[82196]: INFO nova.virt.block_device [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Booting with volume b5f0471b-94d7-446d-9313-3c94d2e9355d at /dev/vdc
Apr 11 19:30:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No VIF found with MAC fa:16:3e:db:2d:10, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.utils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62ad77b-b3c5-4e3e-9ab4-72cb1432ef6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[440c1ceb-828f-42c8-bca3-b723ed3fd345]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6626f9-4422-4fb2-b552-b1e2e9ff4c93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b3bb38-69d8-4e96-8f81-8cf1f20fb6ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:30:22 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:30:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[571695ae-796c-499c-8c37-54fd82a0ce30]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG os_brick.utils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:22 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updating existing volume attachment record: 74591451-38a8-45a8-921e-d161d2130d36 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:30:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-85bb6b9d-cd2c-4807-bdcb-73c24b9e6d9f req-332de453-4ddc-48dc-a2ac-653f417a25f4 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-85bb6b9d-cd2c-4807-bdcb-73c24b9e6d9f req-332de453-4ddc-48dc-a2ac-653f417a25f4 service nova] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-85bb6b9d-cd2c-4807-bdcb-73c24b9e6d9f req-332de453-4ddc-48dc-a2ac-653f417a25f4 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-85bb6b9d-cd2c-4807-bdcb-73c24b9e6d9f req-332de453-4ddc-48dc-a2ac-653f417a25f4 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-85bb6b9d-cd2c-4807-bdcb-73c24b9e6d9f req-332de453-4ddc-48dc-a2ac-653f417a25f4 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] No waiting events found dispatching network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:24 user nova-compute[82196]: WARNING nova.compute.manager [req-85bb6b9d-cd2c-4807-bdcb-73c24b9e6d9f req-332de453-4ddc-48dc-a2ac-653f417a25f4 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received unexpected event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance with vm_state active and task_state rescuing.
Apr 11 19:30:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-0d075bd5-169f-4f14-a661-e8905b23d492 req-5c8cb7c7-b7c9-4afc-960b-fe42b18a5ad7 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0d075bd5-169f-4f14-a661-e8905b23d492 req-5c8cb7c7-b7c9-4afc-960b-fe42b18a5ad7 service nova] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0d075bd5-169f-4f14-a661-e8905b23d492 req-5c8cb7c7-b7c9-4afc-960b-fe42b18a5ad7 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0d075bd5-169f-4f14-a661-e8905b23d492 req-5c8cb7c7-b7c9-4afc-960b-fe42b18a5ad7 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-0d075bd5-169f-4f14-a661-e8905b23d492 req-5c8cb7c7-b7c9-4afc-960b-fe42b18a5ad7 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] No waiting events found dispatching network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:26 user nova-compute[82196]: WARNING nova.compute.manager [req-0d075bd5-169f-4f14-a661-e8905b23d492 req-5c8cb7c7-b7c9-4afc-960b-fe42b18a5ad7 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received unexpected event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance with vm_state active and task_state rescuing.
Apr 11 19:30:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for 864fcd9b-8e5b-4de8-a2e6-292a8907a834 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:30:26 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241426.1270988, 864fcd9b-8e5b-4de8-a2e6-292a8907a834 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:30:26 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] VM Resumed (Lifecycle Event)
Apr 11 19:30:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ff328c4b-f2db-4c88-a0c2-44a71d7a8a2c tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:30:26 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 19:30:26 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241426.1312919, 864fcd9b-8e5b-4de8-a2e6-292a8907a834 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:30:26 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] VM Started (Lifecycle Event)
Apr 11 19:30:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:30:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:27 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'pci_requests' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:27 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'numa_topology' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:27 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:30:27 user nova-compute[82196]: INFO nova.compute.claims [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Claim successful on node user
Apr 11 19:30:27 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:30:27 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:30:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:27 user nova-compute[82196]: INFO nova.network.neutron [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updating port 9e6087aa-464a-450d-bd04-2653d9420094 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquired lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-changed-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Refreshing instance network info cache due to event network-changed-9e6087aa-464a-450d-bd04-2653d9420094. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] Acquiring lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updating instance_info_cache with network_info: [{"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Releasing lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:30:28 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Creating image(s)
Apr 11 19:30:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "/opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "/opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "/opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'trusted_certs' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] Acquired lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG nova.network.neutron [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Refreshing network info cache for port 9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "dbee1c7cedbe49547520d8cccf5fab967c16b753" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "dbee1c7cedbe49547520d8cccf5fab967c16b753" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753.part --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:29 user nova-compute[82196]: INFO nova.compute.manager [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Detaching volume ae9e623b-e20a-47f6-8a7b-d48a85701e3e
Apr 11 19:30:29 user nova-compute[82196]: INFO nova.virt.block_device [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Attempting to driver detach volume ae9e623b-e20a-47f6-8a7b-d48a85701e3e from mountpoint /dev/vdb
Apr 11 19:30:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Attempting to detach device vdb from instance 6802f099-9236-4c79-a892-2963f1b15b0e from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:30:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:30:29 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:30:29 user nova-compute[82196]:   <source dev="/dev/sdc"/>
Apr 11 19:30:29 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:30:29 user nova-compute[82196]:   <serial>ae9e623b-e20a-47f6-8a7b-d48a85701e3e</serial>
Apr 11 19:30:29 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 19:30:29 user nova-compute[82196]: </disk>
Apr 11 19:30:29 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:30:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753.part --force-share --output=json" returned: 0 in 0.201s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:29 user nova-compute[82196]: DEBUG nova.virt.images [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 8fc3d875-6ba4-4cd1-a98a-af1a6f47172f was qcow2, converting to raw {{(pid=82196) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 19:30:29 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:30:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753.part /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753.converted {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:29 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully detached device vdb from instance 6802f099-9236-4c79-a892-2963f1b15b0e from the persistent domain config.
Apr 11 19:30:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6802f099-9236-4c79-a892-2963f1b15b0e from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:30:29 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:30:29 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:30:29 user nova-compute[82196]:   <source dev="/dev/sdc"/>
Apr 11 19:30:29 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:30:29 user nova-compute[82196]:   <serial>ae9e623b-e20a-47f6-8a7b-d48a85701e3e</serial>
Apr 11 19:30:29 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 19:30:29 user nova-compute[82196]: </disk>
Apr 11 19:30:29 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG nova.network.neutron [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updated VIF entry in instance network info cache for port 9e6087aa-464a-450d-bd04-2653d9420094. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG nova.network.neutron [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updating instance_info_cache with network_info: [{"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241430.65769, 6802f099-9236-4c79-a892-2963f1b15b0e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5b2d081e-4d88-4f02-adbd-763a6e72c383 req-09a2ec56-89cb-4b67-ac0f-f5c7615cb0fb service nova] Releasing lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:30:30 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully detached device vdb from instance 6802f099-9236-4c79-a892-2963f1b15b0e from the live domain config.
Apr 11 19:30:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKWyAxXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:30 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753.part /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753.converted" returned: 0 in 0.845s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753.converted --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[78890281-dd37-4ccc-aaf2-f97c598fb047]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:30:30 user nova-compute[82196]: No targets found.
Apr 11 19:30:30 user nova-compute[82196]: iSNS:
Apr 11 19:30:30 user nova-compute[82196]: No targets found.
Apr 11 19:30:30 user nova-compute[82196]: STATIC:
Apr 11 19:30:30 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:30:30 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:30:30 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:30:30 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e
Apr 11 19:30:30 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:30:30 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:30:30 user nova-compute[82196]: FIRMWARE:
Apr 11 19:30:30 user nova-compute[82196]: No targets found.
Apr 11 19:30:30 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:30:30 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:30:30 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e8af72-6a56-4dd5-8285-d5661964985a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4267c985-94e7-4b86-8200-b6a53bffe6a4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:30 user nova-compute[82196]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:30:30 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:30 user nova-compute[82196]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e (non-flash)
Apr 11 19:30:30 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92407a53f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e'): ({'sdc'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Removing single pathed devices sdc {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfb5a1c-844e-49f6-8408-f1735d9b5e0e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "dbee1c7cedbe49547520d8cccf5fab967c16b753" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.121s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b021fcdc-7d04-4ac0-bf7f-3d2675625f92]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flushing IO for device /dev/sdc {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6c0fd8-95e2-426a-af71-f5f8532b3db6]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf52331-81cc-4fe5-b4e1-7c42ea46c6c2]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:30:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e673d2f2-0c01-43ba-9f7b-a4b186ffd50c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753 --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "dbee1c7cedbe49547520d8cccf5fab967c16b753" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "dbee1c7cedbe49547520d8cccf5fab967c16b753" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a1e6f-780d-4bb8-a8f3-b01604dd3d48]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260]
Apr 11 19:30:31 user nova-compute[82196]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e, portal: 172.16.0.220,3260] successful.
Apr 11 19:30:31 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9e623b-e20a-47f6-8a7b-d48a85701e3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38a4c3c-0c8c-4d3d-bcd2-aea4ddcc0ea2]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] <== disconnect_volume: return (423ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753 --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753,backing_fmt=raw /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753,backing_fmt=raw /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk 1073741824" returned: 0 in 0.059s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "dbee1c7cedbe49547520d8cccf5fab967c16b753" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753 --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'migration_context' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:31 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Rebasing disk image.
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 -F raw /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6c3a550e-38a8-4b29-b100-8c3b36812226 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.231s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82196) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.objects.instance [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.compute.manager [req-bf5716dc-76ba-4bf2-a251-b7eb26456c9c req-5f0aba15-3bbc-4233-b186-4a0cea498579 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-unplugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf5716dc-76ba-4bf2-a251-b7eb26456c9c req-5f0aba15-3bbc-4233-b186-4a0cea498579 service nova] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf5716dc-76ba-4bf2-a251-b7eb26456c9c req-5f0aba15-3bbc-4233-b186-4a0cea498579 service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf5716dc-76ba-4bf2-a251-b7eb26456c9c req-5f0aba15-3bbc-4233-b186-4a0cea498579 service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.compute.manager [req-bf5716dc-76ba-4bf2-a251-b7eb26456c9c req-5f0aba15-3bbc-4233-b186-4a0cea498579 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] No waiting events found dispatching network-vif-unplugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:33 user nova-compute[82196]: WARNING nova.compute.manager [req-bf5716dc-76ba-4bf2-a251-b7eb26456c9c req-5f0aba15-3bbc-4233-b186-4a0cea498579 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received unexpected event network-vif-unplugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance with vm_state active and task_state powering-off.
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241418.5866227, fc48e37f-8c00-4e48-bea3-f1c2e54d78b8 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:30:33 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] VM Stopped (Lifecycle Event)
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.compute.manager [None req-21f9428e-897a-4f18-9a6f-7729e085a2c9 None None] [instance: fc48e37f-8c00-4e48-bea3-f1c2e54d78b8] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 -F raw /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk" returned: 0 in 2.218s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Ensure instance console log exists: /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Start _get_guest_xml network_info=[{"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='cfb9fe5289e75b21666bf65a70405d58',container_format='bare',created_at=2023-04-11T19:28:29Z,direct_url=<?>,disk_format='qcow2',id=8fc3d875-6ba4-4cd1-a98a-af1a6f47172f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1219064691-shelved',owner='8d8b189667e34931aa36149620a036e1',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T19:28:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VedmwTzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '720c683f-c03a-444c-92a8-daf97c9f524b', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5f0471b-94d7-446d-9313-3c94d2e9355d', 'serial': 'b5f0471b-94d7-446d-9313-3c94d2e9355d'}, 'attachment_id': '74591451-38a8-45a8-921e-d161d2130d36', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:30:33 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:30:33 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cfb9fe5289e75b21666bf65a70405d58',container_format='bare',created_at=2023-04-11T19:28:29Z,direct_url=<?>,disk_format='qcow2',id=8fc3d875-6ba4-4cd1-a98a-af1a6f47172f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1219064691-shelved',owner='8d8b189667e34931aa36149620a036e1',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T19:28:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'vcpu_model' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VedmwTzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:33 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:30:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:33 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:30:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:33 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d52bf2-b7b4-4a7f-9341-938d63bf9217]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:30:33 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb62ff6-5e7b-488e-875b-56e780eb7939]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d] added
Apr 11 19:30:33 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance destroyed successfully.
Apr 11 19:30:33 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd1252c-dc9a-4e09-8078-780ef57a8c21]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c542f2-19a7-45f9-b3a3-3ffa9de9b96d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VedmwTzY {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VedmwTzY" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed858f3b-617d-456d-a861-503cb64948a8]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VedmwTzY'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54fa7c47-f436-4738-a2b6-47ad61e6d9da tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.915s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[798c26a1-440a-4cad-828f-db725b4dbd36]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84dd63d-aabb-428e-8dd8-5b42db7b324a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1f4029-360b-4f85-840d-934984f8c716]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d, portal: 172.16.0.220,3260]
Apr 11 19:30:34 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d, portal: 172.16.0.220,3260] successful.
Apr 11 19:30:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abb1efd-8a4d-4300-a4e1-1523fbfd8289]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5065492-b9bd-48e7-848b-dfc4ee5b74ad]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:34 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:34 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5790d6a-0bf3-40a8-ab10-7562412e1942]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:30:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VedmwTzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'flavor' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23662316461643436', 'path': '/dev/sdc'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662316461643436', 'path': '/dev/sdc'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1219064691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1219064691',id=20,image_ref='8fc3d875-6ba4-4cd1-a98a-af1a6f47172f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-787762884',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8d8b189667e34931aa36149620a036e1',ramdisk_id='',reservation_id='r-qvcxbxdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-427928846',owner_user_name='tempest-AttachVolumeShelveTestJSON-427928846-project-member',shelved_at='2023-04-11T19:28:33.062307',shelved_host='user',shelved_image_id='8fc3d875-6ba4-4cd1-a98a-af1a6f47172f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0558ba5a2b04d36ba2f2411090cc4e4',uuid=720c683f-c03a-444c-92a8-daf97c9f524b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converting VIF {"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'pci_devices' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:30:35 user nova-compute[82196]:   <uuid>720c683f-c03a-444c-92a8-daf97c9f524b</uuid>
Apr 11 19:30:35 user nova-compute[82196]:   <name>instance-00000014</name>
Apr 11 19:30:35 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:30:35 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:30:35 user nova-compute[82196]:   <metadata>
Apr 11 19:30:35 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:30:35 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:30:35 user nova-compute[82196]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1219064691</nova:name>
Apr 11 19:30:35 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:30:33</nova:creationTime>
Apr 11 19:30:35 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:30:35 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:30:35 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:30:35 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:30:35 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:30:35 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:30:35 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:30:35 user nova-compute[82196]:       <nova:owner>
Apr 11 19:30:35 user nova-compute[82196]:         <nova:user uuid="e0558ba5a2b04d36ba2f2411090cc4e4">tempest-AttachVolumeShelveTestJSON-427928846-project-member</nova:user>
Apr 11 19:30:35 user nova-compute[82196]:         <nova:project uuid="8d8b189667e34931aa36149620a036e1">tempest-AttachVolumeShelveTestJSON-427928846</nova:project>
Apr 11 19:30:35 user nova-compute[82196]:       </nova:owner>
Apr 11 19:30:35 user nova-compute[82196]:       <nova:root type="image" uuid="8fc3d875-6ba4-4cd1-a98a-af1a6f47172f"/>
Apr 11 19:30:35 user nova-compute[82196]:       <nova:ports>
Apr 11 19:30:35 user nova-compute[82196]:         <nova:port uuid="9e6087aa-464a-450d-bd04-2653d9420094">
Apr 11 19:30:35 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 19:30:35 user nova-compute[82196]:         </nova:port>
Apr 11 19:30:35 user nova-compute[82196]:       </nova:ports>
Apr 11 19:30:35 user nova-compute[82196]:     </nova:instance>
Apr 11 19:30:35 user nova-compute[82196]:   </metadata>
Apr 11 19:30:35 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:30:35 user nova-compute[82196]:     <system>
Apr 11 19:30:35 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:30:35 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:30:35 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:30:35 user nova-compute[82196]:       <entry name="serial">720c683f-c03a-444c-92a8-daf97c9f524b</entry>
Apr 11 19:30:35 user nova-compute[82196]:       <entry name="uuid">720c683f-c03a-444c-92a8-daf97c9f524b</entry>
Apr 11 19:30:35 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:30:35 user nova-compute[82196]:     </system>
Apr 11 19:30:35 user nova-compute[82196]:   </sysinfo>
Apr 11 19:30:35 user nova-compute[82196]:   <os>
Apr 11 19:30:35 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:30:35 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:30:35 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:30:35 user nova-compute[82196]:   </os>
Apr 11 19:30:35 user nova-compute[82196]:   <features>
Apr 11 19:30:35 user nova-compute[82196]:     <acpi/>
Apr 11 19:30:35 user nova-compute[82196]:     <apic/>
Apr 11 19:30:35 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:30:35 user nova-compute[82196]:   </features>
Apr 11 19:30:35 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:30:35 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:30:35 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:30:35 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:30:35 user nova-compute[82196]:   </clock>
Apr 11 19:30:35 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:30:35 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:30:35 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:30:35 user nova-compute[82196]:   </cpu>
Apr 11 19:30:35 user nova-compute[82196]:   <devices>
Apr 11 19:30:35 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:30:35 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:30:35 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk"/>
Apr 11 19:30:35 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:30:35 user nova-compute[82196]:     </disk>
Apr 11 19:30:35 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:30:35 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:30:35 user nova-compute[82196]:       <source dev="/dev/sdc"/>
Apr 11 19:30:35 user nova-compute[82196]:       <target dev="vdc" bus="virtio"/>
Apr 11 19:30:35 user nova-compute[82196]:       <serial>b5f0471b-94d7-446d-9313-3c94d2e9355d</serial>
Apr 11 19:30:35 user nova-compute[82196]:     </disk>
Apr 11 19:30:35 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:30:35 user nova-compute[82196]:       <mac address="fa:16:3e:c8:24:ee"/>
Apr 11 19:30:35 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:30:35 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:30:35 user nova-compute[82196]:       <target dev="tap9e6087aa-46"/>
Apr 11 19:30:35 user nova-compute[82196]:     </interface>
Apr 11 19:30:35 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:30:35 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/console.log" append="off"/>
Apr 11 19:30:35 user nova-compute[82196]:     </serial>
Apr 11 19:30:35 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:30:35 user nova-compute[82196]:     <video>
Apr 11 19:30:35 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:30:35 user nova-compute[82196]:     </video>
Apr 11 19:30:35 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:30:35 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:30:35 user nova-compute[82196]:     </rng>
Apr 11 19:30:35 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:30:35 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:30:35 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:30:35 user nova-compute[82196]:     </memballoon>
Apr 11 19:30:35 user nova-compute[82196]:   </devices>
Apr 11 19:30:35 user nova-compute[82196]: </domain>
Apr 11 19:30:35 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1219064691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1219064691',id=20,image_ref='8fc3d875-6ba4-4cd1-a98a-af1a6f47172f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-787762884',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8d8b189667e34931aa36149620a036e1',ramdisk_id='',reservation_id='r-qvcxbxdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-427928846',owner_user_name='tempest-AttachVolumeShelveTestJSON-427928846-project-member',shelved_at='2023-04-11T19:28:33.062307',shelved_host='user',shelved_image_id='8fc3d875-6ba4-4cd1-a98a-af1a6f47172f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0558ba5a2b04d36ba2f2411090cc4e4',uuid=720c683f-c03a-444c-92a8-daf97c9f524b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converting VIF {"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG os_vif [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e6087aa-46, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e6087aa-46, col_values=(('external_ids', {'iface-id': '9e6087aa-464a-450d-bd04-2653d9420094', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:24:ee', 'vm-uuid': '720c683f-c03a-444c-92a8-daf97c9f524b'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:35 user nova-compute[82196]: INFO os_vif [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46')
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:35 user nova-compute[82196]: INFO nova.compute.manager [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Attaching volume 443c1e0d-cc51-400f-8525-c5352514ce7f to /dev/vdb
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] No VIF found with MAC fa:16:3e:c8:24:ee, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG os_brick.utils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[495a349a-51f5-47de-b167-23a8fcf50dd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[049f94e2-7ec9-46d3-bb3c-7757729fd1da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fd11f3-49aa-41a1-960a-24c4ea323ae5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6500abf5-d33d-471d-bff2-8b0ca6197a4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.compute.manager [req-b7468000-cc86-4fdb-9ece-18e8e3dcb445 req-3e29f68c-b792-40af-9383-87e90ca9d3ba service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b7468000-cc86-4fdb-9ece-18e8e3dcb445 req-3e29f68c-b792-40af-9383-87e90ca9d3ba service nova] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b7468000-cc86-4fdb-9ece-18e8e3dcb445 req-3e29f68c-b792-40af-9383-87e90ca9d3ba service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b7468000-cc86-4fdb-9ece-18e8e3dcb445 req-3e29f68c-b792-40af-9383-87e90ca9d3ba service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.compute.manager [req-b7468000-cc86-4fdb-9ece-18e8e3dcb445 req-3e29f68c-b792-40af-9383-87e90ca9d3ba service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] No waiting events found dispatching network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:35 user nova-compute[82196]: WARNING nova.compute.manager [req-b7468000-cc86-4fdb-9ece-18e8e3dcb445 req-3e29f68c-b792-40af-9383-87e90ca9d3ba service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received unexpected event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance with vm_state stopped and task_state None.
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:30:35 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:30:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[60abe4e5-7fe7-4710-9b69-96a8cf285c59]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG os_brick.utils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:35 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating existing volume attachment record: dffb7236-92d8-426f-899f-27f5ef580b26 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:30:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-b0b0f5e2-1f0f-48ed-934c-393ac42f9fb4 req-169b54f2-d14c-40eb-ba46-8a5ef51fae9c service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b0b0f5e2-1f0f-48ed-934c-393ac42f9fb4 req-169b54f2-d14c-40eb-ba46-8a5ef51fae9c service nova] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b0b0f5e2-1f0f-48ed-934c-393ac42f9fb4 req-169b54f2-d14c-40eb-ba46-8a5ef51fae9c service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b0b0f5e2-1f0f-48ed-934c-393ac42f9fb4 req-169b54f2-d14c-40eb-ba46-8a5ef51fae9c service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-b0b0f5e2-1f0f-48ed-934c-393ac42f9fb4 req-169b54f2-d14c-40eb-ba46-8a5ef51fae9c service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] No waiting events found dispatching network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:36 user nova-compute[82196]: WARNING nova.compute.manager [req-b0b0f5e2-1f0f-48ed-934c-393ac42f9fb4 req-169b54f2-d14c-40eb-ba46-8a5ef51fae9c service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received unexpected event network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 19:30:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:37 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:30:38 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:30:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:38 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241438.8864315, 720c683f-c03a-444c-92a8-daf97c9f524b => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:30:38 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] VM Resumed (Lifecycle Event)
Apr 11 19:30:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:30:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:30:38 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Instance spawned successfully.
Apr 11 19:30:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:30:38 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:30:38 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241438.891902, 720c683f-c03a-444c-92a8-daf97c9f524b => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:30:38 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] VM Started (Lifecycle Event)
Apr 11 19:30:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG nova.compute.manager [req-fa2b2227-aa2d-49d7-86bf-e56bbd36964c req-8fbbc62c-00b4-468c-8dd3-e9e669eab41a service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fa2b2227-aa2d-49d7-86bf-e56bbd36964c req-8fbbc62c-00b4-468c-8dd3-e9e669eab41a service nova] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fa2b2227-aa2d-49d7-86bf-e56bbd36964c req-8fbbc62c-00b4-468c-8dd3-e9e669eab41a service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fa2b2227-aa2d-49d7-86bf-e56bbd36964c req-8fbbc62c-00b4-468c-8dd3-e9e669eab41a service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG nova.compute.manager [req-fa2b2227-aa2d-49d7-86bf-e56bbd36964c req-8fbbc62c-00b4-468c-8dd3-e9e669eab41a service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] No waiting events found dispatching network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:39 user nova-compute[82196]: WARNING nova.compute.manager [req-fa2b2227-aa2d-49d7-86bf-e56bbd36964c req-8fbbc62c-00b4-468c-8dd3-e9e669eab41a service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received unexpected event network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 19:30:39 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:30:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3b39ed8f-0877-41c4-b75c-0de820971132 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "720c683f-c03a-444c-92a8-daf97c9f524b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.129s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLdgCADm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:40 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:40 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:40 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Updating instance_info_cache with network_info: [{"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[005a20f4-84f8-4066-8781-de00be4e957b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:30:40 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbbe85d-091d-42b5-a2bf-3f453935a241]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f] added
Apr 11 19:30:40 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b6b5de-94d0-4965-8246-5eb795cb5d15]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7077c70-a95e-47ea-89be-e5d0fd436175]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tLdgCADm {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tLdgCADm" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[308acdd5-b83d-447d-806b-45e4f122df21]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tLdgCADm'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[18824938-6aae-44b1-a729-97b56b548d5e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f13a701-192b-40a1-b8e5-a1486498f856]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:40 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:40 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:40 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:40 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf05a2e-9028-48c2-920e-25fb58632e4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260]
Apr 11 19:30:40 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260] successful.
Apr 11 19:30:40 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f671325-91b0-4d82-98c5-10e2d6592df5]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aad6e5-d6e7-4128-b2e7-102377012088]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:40 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:40 user nova-compute[82196]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:30:40 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:40 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:40 user nova-compute[82196]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:30:40 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbed8f9a-410d-4262-969f-0b3d7fe9d3c8]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:30:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLdgCADm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23132643030636263', 'path': '/dev/sdd'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132643030636263', 'path': '/dev/sdd'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG nova.objects.instance [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'flavor' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:30:41 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:30:41 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:30:41 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:30:41 user nova-compute[82196]:   <serial>443c1e0d-cc51-400f-8525-c5352514ce7f</serial>
Apr 11 19:30:41 user nova-compute[82196]: </disk>
Apr 11 19:30:41 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:30:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No VIF found with MAC fa:16:3e:7a:ec:62, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e0446086-6cfc-4d34-9aaa-a9999bd5543b tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.979s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:43 user nova-compute[82196]: INFO nova.compute.manager [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Rebuilding instance
Apr 11 19:30:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG nova.objects.instance [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'trusted_certs' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG nova.objects.instance [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'pci_requests' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG nova.objects.instance [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'pci_devices' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG nova.objects.instance [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'resources' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG nova.objects.instance [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'migration_context' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG nova.objects.instance [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82196) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-313bf2d0-a789-40d0-9301-933b75838f41 req-4d5fb904-1fbb-48bb-8258-15dcc5e08da6 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-unplugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-313bf2d0-a789-40d0-9301-933b75838f41 req-4d5fb904-1fbb-48bb-8258-15dcc5e08da6 service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-313bf2d0-a789-40d0-9301-933b75838f41 req-4d5fb904-1fbb-48bb-8258-15dcc5e08da6 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-313bf2d0-a789-40d0-9301-933b75838f41 req-4d5fb904-1fbb-48bb-8258-15dcc5e08da6 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-313bf2d0-a789-40d0-9301-933b75838f41 req-4d5fb904-1fbb-48bb-8258-15dcc5e08da6 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-unplugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:44 user nova-compute[82196]: WARNING nova.compute.manager [req-313bf2d0-a789-40d0-9301-933b75838f41 req-4d5fb904-1fbb-48bb-8258-15dcc5e08da6 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-unplugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state active and task_state rebuilding.
Apr 11 19:30:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:30:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:44 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance destroyed successfully.
Apr 11 19:30:45 user nova-compute[82196]: INFO nova.compute.manager [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Detaching volume 443c1e0d-cc51-400f-8525-c5352514ce7f
Apr 11 19:30:45 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:30:45 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7826MB free_disk=26.31881332397461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:45 user nova-compute[82196]: INFO nova.virt.block_device [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Attempting to driver detach volume 443c1e0d-cc51-400f-8525-c5352514ce7f from mountpoint /dev/vdb
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Attempting to detach device vdb from instance 647674d8-af53-405a-8116-4b7a01549bdf from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:30:45 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:30:45 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:30:45 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:30:45 user nova-compute[82196]:   <serial>443c1e0d-cc51-400f-8525-c5352514ce7f</serial>
Apr 11 19:30:45 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:30:45 user nova-compute[82196]: </disk>
Apr 11 19:30:45 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:30:45 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully detached device vdb from instance 647674d8-af53-405a-8116-4b7a01549bdf from the persistent domain config.
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLdgCADm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:45 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6802f099-9236-4c79-a892-2963f1b15b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 558100b9-f3ac-47c7-9260-b897b0cae55f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 720c683f-c03a-444c-92a8-daf97c9f524b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9c8ff4-834a-4dc1-83e4-20d94ec2c2e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:30:45 user nova-compute[82196]: No targets found.
Apr 11 19:30:45 user nova-compute[82196]: iSNS:
Apr 11 19:30:45 user nova-compute[82196]: No targets found.
Apr 11 19:30:45 user nova-compute[82196]: STATIC:
Apr 11 19:30:45 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:30:45 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:30:45 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:30:45 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f
Apr 11 19:30:45 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:30:45 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:30:45 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d
Apr 11 19:30:45 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:30:45 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:30:45 user nova-compute[82196]: FIRMWARE:
Apr 11 19:30:45 user nova-compute[82196]: No targets found.
Apr 11 19:30:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:30:45 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:30:45 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a3dbca-04db-4d95-8f61-4ebdf12c51ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a70b729-2568-4569-9fce-0cfd68a18648]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:45 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:45 user nova-compute[82196]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:30:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:45 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:45 user nova-compute[82196]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:30:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9274180670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f'): ({'sdd'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Removing single pathed devices sdd {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d568d0b-501f-4cb0-af84-106e475e18f5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b20a467-0c1b-43e9-a5cb-41d80ba89eac]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flushing IO for device /dev/sdd {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7574ae7e-e09c-42cd-b6e0-f0ff33b6cff3]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[041e06bb-594a-4417-af25-dea2dd082365]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ade5c00-d33a-46df-9ef3-9933d84ecd31]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b209cc8e-d546-4e28-bf8d-c98b96c1379b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260]
Apr 11 19:30:45 user nova-compute[82196]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260] successful.
Apr 11 19:30:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de91ba7-496a-4c08-b540-5a109ffbe565]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== disconnect_volume: return (313ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:30:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-9791cb49-4d75-4818-ad9f-071eb986dfe6 req-c601a6a8-d0f4-4a24-bfeb-ba10ba3ee210 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9791cb49-4d75-4818-ad9f-071eb986dfe6 req-c601a6a8-d0f4-4a24-bfeb-ba10ba3ee210 service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9791cb49-4d75-4818-ad9f-071eb986dfe6 req-c601a6a8-d0f4-4a24-bfeb-ba10ba3ee210 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9791cb49-4d75-4818-ad9f-071eb986dfe6 req-c601a6a8-d0f4-4a24-bfeb-ba10ba3ee210 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-9791cb49-4d75-4818-ad9f-071eb986dfe6 req-c601a6a8-d0f4-4a24-bfeb-ba10ba3ee210 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:46 user nova-compute[82196]: WARNING nova.compute.manager [req-9791cb49-4d75-4818-ad9f-071eb986dfe6 req-c601a6a8-d0f4-4a24-bfeb-ba10ba3ee210 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state active and task_state rebuilding.
Apr 11 19:30:46 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance destroyed successfully.
Apr 11 19:30:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-505347267',display_name='tempest-ServerActionsTestJSON-server-1599172202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-505347267',id=21,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:26:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-lxpjy0l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=647674d8-af53-405a-8116-4b7a01549bdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_vif [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4e4888a-16, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:46 user nova-compute[82196]: INFO os_vif [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16')
Apr 11 19:30:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLdgCADm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:46 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[545111e8-cce8-4b05-b69b-764edfb7f58c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:30:46 user nova-compute[82196]: No targets found.
Apr 11 19:30:46 user nova-compute[82196]: iSNS:
Apr 11 19:30:46 user nova-compute[82196]: No targets found.
Apr 11 19:30:46 user nova-compute[82196]: STATIC:
Apr 11 19:30:46 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:30:46 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:30:46 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:30:46 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d
Apr 11 19:30:46 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:30:46 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:30:46 user nova-compute[82196]: FIRMWARE:
Apr 11 19:30:46 user nova-compute[82196]: No targets found.
Apr 11 19:30:46 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:30:46 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:30:46 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eeacf3-b3e5-454f-ac9f-e72d2f6afab6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59d2067-57a0-4bbe-8c70-5f900defcf3f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:46 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:46 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:46 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:46 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927c006dd0>, {}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Disconnecting from: [] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== disconnect_volume: return (74ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:30:46 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Deleting instance files /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf_del
Apr 11 19:30:46 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Deletion of /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf_del complete
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:30:46 user nova-compute[82196]: INFO nova.virt.block_device [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Booting with volume 443c1e0d-cc51-400f-8525-c5352514ce7f at /dev/vdb
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.utils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce1a6b0-c2c2-4ca1-b523-bc489316b86c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a9361f-5367-44c1-94ff-b49b32b6a947]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88dd8d5-9d0a-44cf-a7c0-e6235cbb30f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b647115c-0b81-4cde-9659-fd3388753fcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:30:46 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:30:46 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3adb49-eda4-4579-b596-18b573544e4a]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG os_brick.utils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:46 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating existing volume attachment record: 1f3f08b7-f364-4de1-a1bd-2e6d59772f23 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:30:48 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241433.9074037, 6802f099-9236-4c79-a892-2963f1b15b0e => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:30:48 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] VM Stopped (Lifecycle Event)
Apr 11 19:30:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-52286631-4943-47c5-855e-a596038f9b9b None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-52286631-4943-47c5-855e-a596038f9b9b None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:30:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:30:51 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Creating image(s)
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk 1073741824" returned: 0 in 0.060s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Cannot resize image /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Ensure instance console log exists: /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Start _get_guest_xml network_info=[{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLdgCADm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '647674d8-af53-405a-8116-4b7a01549bdf', 'attached_at': '', 'detached_at': '', 'volume_id': '443c1e0d-cc51-400f-8525-c5352514ce7f', 'serial': '443c1e0d-cc51-400f-8525-c5352514ce7f'}, 'attachment_id': '1f3f08b7-f364-4de1-a1bd-2e6d59772f23', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:30:51 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 19:30:51 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.objects.instance [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'vcpu_model' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLdgCADm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:30:51 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 19:30:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:51 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 19:30:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:30:51 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b142ce92-3c99-4ed2-ba52-ba32e9e336c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:30:51 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec2e17b-e81c-4cb2-8137-31280a357d5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f] added
Apr 11 19:30:51 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9651289e-5696-40a6-9b35-de344b8a463c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a4bd15-1298-4836-9b6a-9c452c292fa6]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tLdgCADm {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tLdgCADm" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbd2208-b13c-4f02-b477-f1c6d51d6cce]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tLdgCADm'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c366f5c2-d10e-4850-8c1c-443f2ceeb088]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9534e8c3-9236-4dc9-88f5-807fbd868996]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:52 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:52 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ba1c57-9faa-408d-b03c-76a6f9d55f25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260]
Apr 11 19:30:52 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260] successful.
Apr 11 19:30:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d762975-99aa-4679-97a2-dc76108900d0]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5296d0a7-519b-4c77-89aa-16dca807a1ff]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:52 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:52 user nova-compute[82196]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:30:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:30:52 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:30:52 user nova-compute[82196]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:30:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0d51fc-88ab-4c8d-88f3-95fbfa567d3b]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:30:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLdgCADm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23132643030636263', 'path': '/dev/sdd'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132643030636263', 'path': '/dev/sdd'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-505347267',display_name='tempest-ServerActionsTestJSON-server-1599172202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-505347267',id=21,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:26:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-lxpjy0l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=647674d8-af53-405a-8116-4b7a01549bdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:30:53 user nova-compute[82196]:   <uuid>647674d8-af53-405a-8116-4b7a01549bdf</uuid>
Apr 11 19:30:53 user nova-compute[82196]:   <name>instance-00000015</name>
Apr 11 19:30:53 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:30:53 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:30:53 user nova-compute[82196]:   <metadata>
Apr 11 19:30:53 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:30:53 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:30:53 user nova-compute[82196]:       <nova:name>tempest-ServerActionsTestJSON-server-1599172202</nova:name>
Apr 11 19:30:53 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:30:51</nova:creationTime>
Apr 11 19:30:53 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:30:53 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:30:53 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:30:53 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:30:53 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:30:53 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:30:53 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:30:53 user nova-compute[82196]:       <nova:owner>
Apr 11 19:30:53 user nova-compute[82196]:         <nova:user uuid="05fb551c320a48f98a4ec00a7f7492d7">tempest-ServerActionsTestJSON-37730514-project-member</nova:user>
Apr 11 19:30:53 user nova-compute[82196]:         <nova:project uuid="60a7381a31b84e97a068528f90813773">tempest-ServerActionsTestJSON-37730514</nova:project>
Apr 11 19:30:53 user nova-compute[82196]:       </nova:owner>
Apr 11 19:30:53 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:30:53 user nova-compute[82196]:       <nova:ports>
Apr 11 19:30:53 user nova-compute[82196]:         <nova:port uuid="e4e4888a-168a-4fe8-a43e-ee683b50a39a">
Apr 11 19:30:53 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 19:30:53 user nova-compute[82196]:         </nova:port>
Apr 11 19:30:53 user nova-compute[82196]:       </nova:ports>
Apr 11 19:30:53 user nova-compute[82196]:     </nova:instance>
Apr 11 19:30:53 user nova-compute[82196]:   </metadata>
Apr 11 19:30:53 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:30:53 user nova-compute[82196]:     <system>
Apr 11 19:30:53 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:30:53 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:30:53 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:30:53 user nova-compute[82196]:       <entry name="serial">647674d8-af53-405a-8116-4b7a01549bdf</entry>
Apr 11 19:30:53 user nova-compute[82196]:       <entry name="uuid">647674d8-af53-405a-8116-4b7a01549bdf</entry>
Apr 11 19:30:53 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:30:53 user nova-compute[82196]:     </system>
Apr 11 19:30:53 user nova-compute[82196]:   </sysinfo>
Apr 11 19:30:53 user nova-compute[82196]:   <os>
Apr 11 19:30:53 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:30:53 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:30:53 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:30:53 user nova-compute[82196]:   </os>
Apr 11 19:30:53 user nova-compute[82196]:   <features>
Apr 11 19:30:53 user nova-compute[82196]:     <acpi/>
Apr 11 19:30:53 user nova-compute[82196]:     <apic/>
Apr 11 19:30:53 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:30:53 user nova-compute[82196]:   </features>
Apr 11 19:30:53 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:30:53 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:30:53 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:30:53 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:30:53 user nova-compute[82196]:   </clock>
Apr 11 19:30:53 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:30:53 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:30:53 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:30:53 user nova-compute[82196]:   </cpu>
Apr 11 19:30:53 user nova-compute[82196]:   <devices>
Apr 11 19:30:53 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:30:53 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:30:53 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk"/>
Apr 11 19:30:53 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:30:53 user nova-compute[82196]:     </disk>
Apr 11 19:30:53 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:30:53 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:30:53 user nova-compute[82196]:       <source dev="/dev/sdd"/>
Apr 11 19:30:53 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:30:53 user nova-compute[82196]:       <serial>443c1e0d-cc51-400f-8525-c5352514ce7f</serial>
Apr 11 19:30:53 user nova-compute[82196]:     </disk>
Apr 11 19:30:53 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:30:53 user nova-compute[82196]:       <mac address="fa:16:3e:7a:ec:62"/>
Apr 11 19:30:53 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:30:53 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:30:53 user nova-compute[82196]:       <target dev="tape4e4888a-16"/>
Apr 11 19:30:53 user nova-compute[82196]:     </interface>
Apr 11 19:30:53 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:30:53 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/console.log" append="off"/>
Apr 11 19:30:53 user nova-compute[82196]:     </serial>
Apr 11 19:30:53 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:30:53 user nova-compute[82196]:     <video>
Apr 11 19:30:53 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:30:53 user nova-compute[82196]:     </video>
Apr 11 19:30:53 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:30:53 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:30:53 user nova-compute[82196]:     </rng>
Apr 11 19:30:53 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:30:53 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:30:53 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:30:53 user nova-compute[82196]:     </memballoon>
Apr 11 19:30:53 user nova-compute[82196]:   </devices>
Apr 11 19:30:53 user nova-compute[82196]: </domain>
Apr 11 19:30:53 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-505347267',display_name='tempest-ServerActionsTestJSON-server-1599172202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-505347267',id=21,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:26:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-lxpjy0l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=647674d8-af53-405a-8116-4b7a01549bdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG os_vif [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4e4888a-16, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4e4888a-16, col_values=(('external_ids', {'iface-id': 'e4e4888a-168a-4fe8-a43e-ee683b50a39a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:ec:62', 'vm-uuid': '647674d8-af53-405a-8116-4b7a01549bdf'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:53 user nova-compute[82196]: INFO os_vif [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16')
Apr 11 19:30:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:30:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No VIF found with MAC fa:16:3e:7a:ec:62, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:30:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-8428a32d-63ef-4127-a7d1-0c92de1ff203 req-2de4f26c-a0fe-4ab0-8753-ceb8c4a7d129 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8428a32d-63ef-4127-a7d1-0c92de1ff203 req-2de4f26c-a0fe-4ab0-8753-ceb8c4a7d129 service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8428a32d-63ef-4127-a7d1-0c92de1ff203 req-2de4f26c-a0fe-4ab0-8753-ceb8c4a7d129 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8428a32d-63ef-4127-a7d1-0c92de1ff203 req-2de4f26c-a0fe-4ab0-8753-ceb8c4a7d129 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-8428a32d-63ef-4127-a7d1-0c92de1ff203 req-2de4f26c-a0fe-4ab0-8753-ceb8c4a7d129 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:54 user nova-compute[82196]: WARNING nova.compute.manager [req-8428a32d-63ef-4127-a7d1-0c92de1ff203 req-2de4f26c-a0fe-4ab0-8753-ceb8c4a7d129 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state active and task_state rebuild_spawning.
Apr 11 19:30:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for 647674d8-af53-405a-8116-4b7a01549bdf due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241456.6664226, 647674d8-af53-405a-8116-4b7a01549bdf => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:30:56 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] VM Resumed (Lifecycle Event)
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:30:56 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance spawned successfully.
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:30:56 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241456.670436, 647674d8-af53-405a-8116-4b7a01549bdf => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:30:56 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] VM Started (Lifecycle Event)
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:30:56 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.objects.instance [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82196) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-268cdab6-4452-4e26-a29b-b48c6882ca95 req-4bee8c6c-3681-45e9-bfd4-5f0231417476 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-268cdab6-4452-4e26-a29b-b48c6882ca95 req-4bee8c6c-3681-45e9-bfd4-5f0231417476 service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-268cdab6-4452-4e26-a29b-b48c6882ca95 req-4bee8c6c-3681-45e9-bfd4-5f0231417476 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-268cdab6-4452-4e26-a29b-b48c6882ca95 req-4bee8c6c-3681-45e9-bfd4-5f0231417476 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-268cdab6-4452-4e26-a29b-b48c6882ca95 req-4bee8c6c-3681-45e9-bfd4-5f0231417476 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:30:56 user nova-compute[82196]: WARNING nova.compute.manager [req-268cdab6-4452-4e26-a29b-b48c6882ca95 req-4bee8c6c-3681-45e9-bfd4-5f0231417476 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state active and task_state None.
Apr 11 19:30:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-59a61abf-bf69-4808-8186-9401c1657f72 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:30:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:30:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:00 user nova-compute[82196]: INFO nova.compute.manager [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Terminating instance
Apr 11 19:31:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-f86ee8cc-1600-44db-a700-1147c0d9f98f req-58451203-604b-4905-872e-ada370124eae service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Received event network-vif-unplugged-32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f86ee8cc-1600-44db-a700-1147c0d9f98f req-58451203-604b-4905-872e-ada370124eae service nova] Acquiring lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f86ee8cc-1600-44db-a700-1147c0d9f98f req-58451203-604b-4905-872e-ada370124eae service nova] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f86ee8cc-1600-44db-a700-1147c0d9f98f req-58451203-604b-4905-872e-ada370124eae service nova] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-f86ee8cc-1600-44db-a700-1147c0d9f98f req-58451203-604b-4905-872e-ada370124eae service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] No waiting events found dispatching network-vif-unplugged-32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-f86ee8cc-1600-44db-a700-1147c0d9f98f req-58451203-604b-4905-872e-ada370124eae service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Received event network-vif-unplugged-32cb9325-7443-4bd8-ad26-e54700ba6bf4 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:31:00 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Instance destroyed successfully.
Apr 11 19:31:00 user nova-compute[82196]: DEBUG nova.objects.instance [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lazy-loading 'resources' on Instance uuid 9466c3da-2c99-41ea-9fb4-41ffbaa9910a {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1598011629',display_name='tempest-VolumesNegativeTest-instance-1598011629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1598011629',id=24,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:29:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e983656394754cf68837587d74f9fbb3',ramdisk_id='',reservation_id='r-5jyooytq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1402597116',owner_user_name='tempest-VolumesNegativeTest-1402597116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:29:16Z,user_data=None,user_id='996881d74ec246f0ac53411a8ca0e7c4',uuid=9466c3da-2c99-41ea-9fb4-41ffbaa9910a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "address": "fa:16:3e:4c:10:03", "network": {"id": "fdd61e06-072c-4b1b-bd29-b291c80fd5a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fbdf09eea41f454e9a1bb9864af731dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32cb9325-74", "ovs_interfaceid": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Converting VIF {"id": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "address": "fa:16:3e:4c:10:03", "network": {"id": "fdd61e06-072c-4b1b-bd29-b291c80fd5a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fbdf09eea41f454e9a1bb9864af731dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32cb9325-74", "ovs_interfaceid": "32cb9325-7443-4bd8-ad26-e54700ba6bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:10:03,bridge_name='br-int',has_traffic_filtering=True,id=32cb9325-7443-4bd8-ad26-e54700ba6bf4,network=Network(fdd61e06-072c-4b1b-bd29-b291c80fd5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32cb9325-74') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG os_vif [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:10:03,bridge_name='br-int',has_traffic_filtering=True,id=32cb9325-7443-4bd8-ad26-e54700ba6bf4,network=Network(fdd61e06-072c-4b1b-bd29-b291c80fd5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32cb9325-74') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32cb9325-74, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:00 user nova-compute[82196]: INFO os_vif [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:10:03,bridge_name='br-int',has_traffic_filtering=True,id=32cb9325-7443-4bd8-ad26-e54700ba6bf4,network=Network(fdd61e06-072c-4b1b-bd29-b291c80fd5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32cb9325-74')
Apr 11 19:31:00 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Deleting instance files /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a_del
Apr 11 19:31:00 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Deletion of /opt/stack/data/nova/instances/9466c3da-2c99-41ea-9fb4-41ffbaa9910a_del complete
Apr 11 19:31:00 user nova-compute[82196]: INFO nova.compute.manager [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 11 19:31:00 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:31:00 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:31:01 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:31:01 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Took 0.69 seconds to deallocate network for instance.
Apr 11 19:31:01 user nova-compute[82196]: DEBUG nova.compute.manager [req-f9d34e2d-9e89-43d1-85b4-b050aa6d8718 req-f040215f-75f7-41b0-83ab-38c36e929482 service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Received event network-vif-deleted-32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:01 user nova-compute[82196]: INFO nova.compute.manager [req-f9d34e2d-9e89-43d1-85b4-b050aa6d8718 req-f040215f-75f7-41b0-83ab-38c36e929482 service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Neutron deleted interface 32cb9325-7443-4bd8-ad26-e54700ba6bf4; detaching it from the instance and deleting it from the info cache
Apr 11 19:31:01 user nova-compute[82196]: DEBUG nova.network.neutron [req-f9d34e2d-9e89-43d1-85b4-b050aa6d8718 req-f040215f-75f7-41b0-83ab-38c36e929482 service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:31:01 user nova-compute[82196]: DEBUG nova.compute.manager [req-f9d34e2d-9e89-43d1-85b4-b050aa6d8718 req-f040215f-75f7-41b0-83ab-38c36e929482 service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Detach interface failed, port_id=32cb9325-7443-4bd8-ad26-e54700ba6bf4, reason: Instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:31:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:01 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:31:01 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:31:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:01 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Deleted allocations for instance 9466c3da-2c99-41ea-9fb4-41ffbaa9910a
Apr 11 19:31:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9aa0c57b-ac80-4e2c-9642-de39bf0c7627 tempest-VolumesNegativeTest-1402597116 tempest-VolumesNegativeTest-1402597116-project-member] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.057s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-062b0297-f68e-438c-bd35-90d31cbb9152 req-2751e096-3517-4717-aee9-c460cdb8b143 service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Received event network-vif-plugged-32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-062b0297-f68e-438c-bd35-90d31cbb9152 req-2751e096-3517-4717-aee9-c460cdb8b143 service nova] Acquiring lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-062b0297-f68e-438c-bd35-90d31cbb9152 req-2751e096-3517-4717-aee9-c460cdb8b143 service nova] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-062b0297-f68e-438c-bd35-90d31cbb9152 req-2751e096-3517-4717-aee9-c460cdb8b143 service nova] Lock "9466c3da-2c99-41ea-9fb4-41ffbaa9910a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-062b0297-f68e-438c-bd35-90d31cbb9152 req-2751e096-3517-4717-aee9-c460cdb8b143 service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] No waiting events found dispatching network-vif-plugged-32cb9325-7443-4bd8-ad26-e54700ba6bf4 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:02 user nova-compute[82196]: WARNING nova.compute.manager [req-062b0297-f68e-438c-bd35-90d31cbb9152 req-2751e096-3517-4717-aee9-c460cdb8b143 service nova] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Received unexpected event network-vif-plugged-32cb9325-7443-4bd8-ad26-e54700ba6bf4 for instance with vm_state deleted and task_state None.
Apr 11 19:31:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "558100b9-f3ac-47c7-9260-b897b0cae55f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:08 user nova-compute[82196]: INFO nova.compute.manager [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Terminating instance
Apr 11 19:31:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG nova.compute.manager [req-b0cc0682-6bea-4b99-b1c5-584e793e7c9f req-476d9f91-b035-4c20-85af-3a4be27d2710 service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received event network-vif-unplugged-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b0cc0682-6bea-4b99-b1c5-584e793e7c9f req-476d9f91-b035-4c20-85af-3a4be27d2710 service nova] Acquiring lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b0cc0682-6bea-4b99-b1c5-584e793e7c9f req-476d9f91-b035-4c20-85af-3a4be27d2710 service nova] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b0cc0682-6bea-4b99-b1c5-584e793e7c9f req-476d9f91-b035-4c20-85af-3a4be27d2710 service nova] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG nova.compute.manager [req-b0cc0682-6bea-4b99-b1c5-584e793e7c9f req-476d9f91-b035-4c20-85af-3a4be27d2710 service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] No waiting events found dispatching network-vif-unplugged-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG nova.compute.manager [req-b0cc0682-6bea-4b99-b1c5-584e793e7c9f req-476d9f91-b035-4c20-85af-3a4be27d2710 service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received event network-vif-unplugged-4f568bd5-7271-434e-a30e-beb13759e1f1 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Instance destroyed successfully.
Apr 11 19:31:08 user nova-compute[82196]: DEBUG nova.objects.instance [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'resources' on Instance uuid 558100b9-f3ac-47c7-9260-b897b0cae55f {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-685848689',display_name='tempest-AttachVolumeNegativeTest-server-685848689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-685848689',id=22,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0gNEuZy4WwlntDCrxaO0By8v6wh2LPSvcUjVDg7AoB9duP6CtOuqC+mGfVgzWe8DlNEj6aUlezeF0+IV6nwjLFlAzfgxa89U94DyhZnjYMUBWl9xaaflLwBRbhfRP9Mg==',key_name='tempest-keypair-1056959304',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:28:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06966e2f4d3a4dec92282c7ad348635d',ramdisk_id='',reservation_id='r-93najogc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-303418642',owner_user_name='tempest-AttachVolumeNegativeTest-303418642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:28:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d405421ceb4d99967ef2e7f55e7809',uuid=558100b9-f3ac-47c7-9260-b897b0cae55f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f568bd5-7271-434e-a30e-beb13759e1f1", "address": "fa:16:3e:93:57:af", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f568bd5-72", "ovs_interfaceid": "4f568bd5-7271-434e-a30e-beb13759e1f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converting VIF {"id": "4f568bd5-7271-434e-a30e-beb13759e1f1", "address": "fa:16:3e:93:57:af", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f568bd5-72", "ovs_interfaceid": "4f568bd5-7271-434e-a30e-beb13759e1f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:57:af,bridge_name='br-int',has_traffic_filtering=True,id=4f568bd5-7271-434e-a30e-beb13759e1f1,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f568bd5-72') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG os_vif [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:57:af,bridge_name='br-int',has_traffic_filtering=True,id=4f568bd5-7271-434e-a30e-beb13759e1f1,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f568bd5-72') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f568bd5-72, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:08 user nova-compute[82196]: INFO os_vif [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:57:af,bridge_name='br-int',has_traffic_filtering=True,id=4f568bd5-7271-434e-a30e-beb13759e1f1,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f568bd5-72')
Apr 11 19:31:08 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Deleting instance files /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f_del
Apr 11 19:31:08 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Deletion of /opt/stack/data/nova/instances/558100b9-f3ac-47c7-9260-b897b0cae55f_del complete
Apr 11 19:31:08 user nova-compute[82196]: INFO nova.compute.manager [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 11 19:31:08 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:31:08 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:31:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:09 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:31:09 user nova-compute[82196]: DEBUG nova.compute.manager [req-313d80ab-9abd-4c6c-9a84-813b56f5ea9f req-1af1bf09-8710-4248-9763-155def26785b service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received event network-vif-deleted-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:09 user nova-compute[82196]: INFO nova.compute.manager [req-313d80ab-9abd-4c6c-9a84-813b56f5ea9f req-1af1bf09-8710-4248-9763-155def26785b service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Neutron deleted interface 4f568bd5-7271-434e-a30e-beb13759e1f1; detaching it from the instance and deleting it from the info cache
Apr 11 19:31:09 user nova-compute[82196]: DEBUG nova.network.neutron [req-313d80ab-9abd-4c6c-9a84-813b56f5ea9f req-1af1bf09-8710-4248-9763-155def26785b service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:31:09 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Took 0.81 seconds to deallocate network for instance.
Apr 11 19:31:09 user nova-compute[82196]: DEBUG nova.compute.manager [req-313d80ab-9abd-4c6c-9a84-813b56f5ea9f req-1af1bf09-8710-4248-9763-155def26785b service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Detach interface failed, port_id=4f568bd5-7271-434e-a30e-beb13759e1f1, reason: Instance 558100b9-f3ac-47c7-9260-b897b0cae55f could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:31:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:10 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:31:10 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:31:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:10 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Deleted allocations for instance 558100b9-f3ac-47c7-9260-b897b0cae55f
Apr 11 19:31:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e96ee497-4b7f-4a6c-9555-0846b4f172f8 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received event network-vif-plugged-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] Acquiring lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] No waiting events found dispatching network-vif-plugged-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:10 user nova-compute[82196]: WARNING nova.compute.manager [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received unexpected event network-vif-plugged-4f568bd5-7271-434e-a30e-beb13759e1f1 for instance with vm_state deleted and task_state None.
Apr 11 19:31:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received event network-vif-plugged-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] Acquiring lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] Lock "558100b9-f3ac-47c7-9260-b897b0cae55f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] No waiting events found dispatching network-vif-plugged-4f568bd5-7271-434e-a30e-beb13759e1f1 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:10 user nova-compute[82196]: WARNING nova.compute.manager [req-a990ed6b-f8aa-4470-b6d1-0c0cc232627a req-be4bfb50-40bf-4898-bb81-dec8bb56371a service nova] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Received unexpected event network-vif-plugged-4f568bd5-7271-434e-a30e-beb13759e1f1 for instance with vm_state deleted and task_state None.
Apr 11 19:31:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:15 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241460.791574, 9466c3da-2c99-41ea-9fb4-41ffbaa9910a => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:31:15 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] VM Stopped (Lifecycle Event)
Apr 11 19:31:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-753addc9-b72a-40bf-9ea7-6778bc528580 None None] [instance: 9466c3da-2c99-41ea-9fb4-41ffbaa9910a] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:31:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:23 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241468.7940145, 558100b9-f3ac-47c7-9260-b897b0cae55f => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:31:23 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] VM Stopped (Lifecycle Event)
Apr 11 19:31:23 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d0673e0d-1e35-4975-bbb0-29fce3e273f4 None None] [instance: 558100b9-f3ac-47c7-9260-b897b0cae55f] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:31:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:31:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:31:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:31:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:31:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:31:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:35 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:31:37 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:31:38 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:31:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:39 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:31:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:31:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:31:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:31:39 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:31:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:40 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Updating instance_info_cache with network_info: [{"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:31:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:31:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:31:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:31:41 user nova-compute[82196]: INFO nova.compute.manager [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Rescuing
Apr 11 19:31:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:31:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquired lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:31:41 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:31:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:31:41 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Updating instance_info_cache with network_info: [{"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:31:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Releasing lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.compute.manager [req-5daf941c-7924-4266-8fb0-2cf48bd09dd2 req-c55e5552-a574-4c96-a6e2-ae2fe362d361 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-unplugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5daf941c-7924-4266-8fb0-2cf48bd09dd2 req-c55e5552-a574-4c96-a6e2-ae2fe362d361 service nova] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5daf941c-7924-4266-8fb0-2cf48bd09dd2 req-c55e5552-a574-4c96-a6e2-ae2fe362d361 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5daf941c-7924-4266-8fb0-2cf48bd09dd2 req-c55e5552-a574-4c96-a6e2-ae2fe362d361 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.compute.manager [req-5daf941c-7924-4266-8fb0-2cf48bd09dd2 req-c55e5552-a574-4c96-a6e2-ae2fe362d361 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] No waiting events found dispatching network-vif-unplugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:42 user nova-compute[82196]: WARNING nova.compute.manager [req-5daf941c-7924-4266-8fb0-2cf48bd09dd2 req-c55e5552-a574-4c96-a6e2-ae2fe362d361 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received unexpected event network-vif-unplugged-1c929bc1-2708-4e38-80b3-354812ccb529 for instance with vm_state active and task_state rescuing.
Apr 11 19:31:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:42 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Instance destroyed successfully.
Apr 11 19:31:42 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Attempting rescue
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82196) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Instance directory exists: not creating {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 19:31:42 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Creating image(s)
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "/opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "/opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f2616ce-4924-4b82-996a-2596ae8856a4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.153s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue" returned: 0 in 0.059s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'migration_context' on Instance uuid 6f2616ce-4924-4b82-996a-2596ae8856a4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Start _get_guest_xml network_info=[{"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "vif_mac": "fa:16:3e:d5:ad:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'resources' on Instance uuid 6f2616ce-4924-4b82-996a-2596ae8856a4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f2616ce-4924-4b82-996a-2596ae8856a4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:31:42 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:31:42 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:31:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f2616ce-4924-4b82-996a-2596ae8856a4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1478797351',display_name='tempest-ServerRescueNegativeTestJSON-server-1478797351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1478797351',id=26,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8e3a291c54b49db8e12a88ba41865e3',ramdisk_id='',reservation_id='r-wmbysh2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1429831687',owner_user_name='tempest-ServerRescueNegativeTestJSON-1429831687-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:29:58Z,user_data=None,user_id='ba7f82b529e74d99838b6264b94d823b',uuid=6f2616ce-4924-4b82-996a-2596ae8856a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "vif_mac": "fa:16:3e:d5:ad:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converting VIF {"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "vif_mac": "fa:16:3e:d5:ad:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:ad:54,bridge_name='br-int',has_traffic_filtering=True,id=1c929bc1-2708-4e38-80b3-354812ccb529,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c929bc1-27') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f2616ce-4924-4b82-996a-2596ae8856a4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:31:43 user nova-compute[82196]:   <uuid>6f2616ce-4924-4b82-996a-2596ae8856a4</uuid>
Apr 11 19:31:43 user nova-compute[82196]:   <name>instance-0000001a</name>
Apr 11 19:31:43 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:31:43 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:31:43 user nova-compute[82196]:   <metadata>
Apr 11 19:31:43 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:31:43 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:31:43 user nova-compute[82196]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1478797351</nova:name>
Apr 11 19:31:43 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:31:42</nova:creationTime>
Apr 11 19:31:43 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:31:43 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:31:43 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:31:43 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:31:43 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:31:43 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:31:43 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:31:43 user nova-compute[82196]:       <nova:owner>
Apr 11 19:31:43 user nova-compute[82196]:         <nova:user uuid="ba7f82b529e74d99838b6264b94d823b">tempest-ServerRescueNegativeTestJSON-1429831687-project-member</nova:user>
Apr 11 19:31:43 user nova-compute[82196]:         <nova:project uuid="b8e3a291c54b49db8e12a88ba41865e3">tempest-ServerRescueNegativeTestJSON-1429831687</nova:project>
Apr 11 19:31:43 user nova-compute[82196]:       </nova:owner>
Apr 11 19:31:43 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:31:43 user nova-compute[82196]:       <nova:ports>
Apr 11 19:31:43 user nova-compute[82196]:         <nova:port uuid="1c929bc1-2708-4e38-80b3-354812ccb529">
Apr 11 19:31:43 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 19:31:43 user nova-compute[82196]:         </nova:port>
Apr 11 19:31:43 user nova-compute[82196]:       </nova:ports>
Apr 11 19:31:43 user nova-compute[82196]:     </nova:instance>
Apr 11 19:31:43 user nova-compute[82196]:   </metadata>
Apr 11 19:31:43 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:31:43 user nova-compute[82196]:     <system>
Apr 11 19:31:43 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:31:43 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:31:43 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:31:43 user nova-compute[82196]:       <entry name="serial">6f2616ce-4924-4b82-996a-2596ae8856a4</entry>
Apr 11 19:31:43 user nova-compute[82196]:       <entry name="uuid">6f2616ce-4924-4b82-996a-2596ae8856a4</entry>
Apr 11 19:31:43 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:31:43 user nova-compute[82196]:     </system>
Apr 11 19:31:43 user nova-compute[82196]:   </sysinfo>
Apr 11 19:31:43 user nova-compute[82196]:   <os>
Apr 11 19:31:43 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:31:43 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:31:43 user nova-compute[82196]:   </os>
Apr 11 19:31:43 user nova-compute[82196]:   <features>
Apr 11 19:31:43 user nova-compute[82196]:     <acpi/>
Apr 11 19:31:43 user nova-compute[82196]:     <apic/>
Apr 11 19:31:43 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:31:43 user nova-compute[82196]:   </features>
Apr 11 19:31:43 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:31:43 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:31:43 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:31:43 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:31:43 user nova-compute[82196]:   </clock>
Apr 11 19:31:43 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:31:43 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:31:43 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:31:43 user nova-compute[82196]:   </cpu>
Apr 11 19:31:43 user nova-compute[82196]:   <devices>
Apr 11 19:31:43 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:31:43 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:31:43 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue"/>
Apr 11 19:31:43 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:31:43 user nova-compute[82196]:     </disk>
Apr 11 19:31:43 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:31:43 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:31:43 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk"/>
Apr 11 19:31:43 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:31:43 user nova-compute[82196]:     </disk>
Apr 11 19:31:43 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:31:43 user nova-compute[82196]:       <mac address="fa:16:3e:d5:ad:54"/>
Apr 11 19:31:43 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:31:43 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:31:43 user nova-compute[82196]:       <target dev="tap1c929bc1-27"/>
Apr 11 19:31:43 user nova-compute[82196]:     </interface>
Apr 11 19:31:43 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:31:43 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/console.log" append="off"/>
Apr 11 19:31:43 user nova-compute[82196]:     </serial>
Apr 11 19:31:43 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:31:43 user nova-compute[82196]:     <video>
Apr 11 19:31:43 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:31:43 user nova-compute[82196]:     </video>
Apr 11 19:31:43 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:31:43 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:31:43 user nova-compute[82196]:     </rng>
Apr 11 19:31:43 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:31:43 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:31:43 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:31:43 user nova-compute[82196]:     </memballoon>
Apr 11 19:31:43 user nova-compute[82196]:   </devices>
Apr 11 19:31:43 user nova-compute[82196]: </domain>
Apr 11 19:31:43 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:31:43 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Instance destroyed successfully.
Apr 11 19:31:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No VIF found with MAC fa:16:3e:d5:ad:54, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] No waiting events found dispatching network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:44 user nova-compute[82196]: WARNING nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received unexpected event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 for instance with vm_state active and task_state rescuing.
Apr 11 19:31:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] No waiting events found dispatching network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:44 user nova-compute[82196]: WARNING nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received unexpected event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 for instance with vm_state active and task_state rescuing.
Apr 11 19:31:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] No waiting events found dispatching network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:44 user nova-compute[82196]: WARNING nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received unexpected event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 for instance with vm_state active and task_state rescuing.
Apr 11 19:31:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-unplugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] No waiting events found dispatching network-vif-unplugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:44 user nova-compute[82196]: WARNING nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received unexpected event network-vif-unplugged-1c929bc1-2708-4e38-80b3-354812ccb529 for instance with vm_state active and task_state rescuing.
Apr 11 19:31:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] No waiting events found dispatching network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:44 user nova-compute[82196]: WARNING nova.compute.manager [req-0747b5e6-e7e9-4408-9384-1b10a33e1b73 req-aef93a17-e796-488f-9973-1e5f141de7d6 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received unexpected event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 for instance with vm_state active and task_state rescuing.
Apr 11 19:31:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] No waiting events found dispatching network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:46 user nova-compute[82196]: WARNING nova.compute.manager [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received unexpected event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 for instance with vm_state active and task_state rescuing.
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] No waiting events found dispatching network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:31:46 user nova-compute[82196]: WARNING nova.compute.manager [req-cb46bab4-3c82-4303-a49a-409bc9580495 req-91660644-2b44-4ee0-a064-2e1db6918d32 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received unexpected event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 for instance with vm_state active and task_state rescuing.
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for 6f2616ce-4924-4b82-996a-2596ae8856a4 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241506.6066198, 6f2616ce-4924-4b82-996a-2596ae8856a4 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:31:46 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] VM Resumed (Lifecycle Event)
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ffcd951d-f883-45c7-9958-265fe40e5f35 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:31:46 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:31:46 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8077MB free_disk=26.345256805419922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:31:46 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241506.6075723, 6f2616ce-4924-4b82-996a-2596ae8856a4 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:31:46 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] VM Started (Lifecycle Event)
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6802f099-9236-4c79-a892-2963f1b15b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 720c683f-c03a-444c-92a8-daf97c9f524b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:31:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:31:47 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:31:47 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:31:47 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:31:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:31:48 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:31:48 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:31:48 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:31:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:31:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:31:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "e6e3640a-c262-4e2d-a994-2e4312f22871" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:32:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:32:02 user nova-compute[82196]: INFO nova.compute.claims [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Claim successful on node user
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.network.neutron [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:32:03 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.policy [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5d405421ceb4d99967ef2e7f55e7809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06966e2f4d3a4dec92282c7ad348635d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:32:03 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Creating image(s)
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "/opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "/opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk 1073741824" returned: 0 in 0.051s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Cannot resize image /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.objects.instance [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'migration_context' on Instance uuid e6e3640a-c262-4e2d-a994-2e4312f22871 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Ensure instance console log exists: /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:04 user nova-compute[82196]: DEBUG nova.network.neutron [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Successfully created port: 183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:32:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:32:06 user nova-compute[82196]: INFO nova.compute.claims [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Claim successful on node user
Apr 11 19:32:06 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG nova.network.neutron [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:32:06 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:32:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG nova.policy [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20f337feb0ed4653976ace530bfdd877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5246cf04a7401388cba38d16e298ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:32:06 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Creating image(s)
Apr 11 19:32:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "/opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "/opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "/opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk 1073741824" returned: 0 in 0.049s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.network.neutron [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Successfully updated port: 183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "refresh_cache-e6e3640a-c262-4e2d-a994-2e4312f22871" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquired lock "refresh_cache-e6e3640a-c262-4e2d-a994-2e4312f22871" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.network.neutron [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.167s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.network.neutron [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Successfully created port: 2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.compute.manager [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Received event network-changed-183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.compute.manager [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Refreshing instance network info cache due to event network-changed-183a0478-c117-4fe1-acce-22e4aee440c9. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] Acquiring lock "refresh_cache-e6e3640a-c262-4e2d-a994-2e4312f22871" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.network.neutron [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Cannot resize image /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.objects.instance [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'migration_context' on Instance uuid 03bb985c-4903-4d0e-98a1-43a9352f4ec6 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Ensure instance console log exists: /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.network.neutron [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Updating instance_info_cache with network_info: [{"id": "183a0478-c117-4fe1-acce-22e4aee440c9", "address": "fa:16:3e:6c:3e:6d", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183a0478-c1", "ovs_interfaceid": "183a0478-c117-4fe1-acce-22e4aee440c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Releasing lock "refresh_cache-e6e3640a-c262-4e2d-a994-2e4312f22871" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Instance network_info: |[{"id": "183a0478-c117-4fe1-acce-22e4aee440c9", "address": "fa:16:3e:6c:3e:6d", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183a0478-c1", "ovs_interfaceid": "183a0478-c117-4fe1-acce-22e4aee440c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] Acquired lock "refresh_cache-e6e3640a-c262-4e2d-a994-2e4312f22871" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.network.neutron [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Refreshing network info cache for port 183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Start _get_guest_xml network_info=[{"id": "183a0478-c117-4fe1-acce-22e4aee440c9", "address": "fa:16:3e:6c:3e:6d", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183a0478-c1", "ovs_interfaceid": "183a0478-c117-4fe1-acce-22e4aee440c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:32:07 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:32:07 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2097763810',display_name='tempest-AttachVolumeNegativeTest-server-2097763810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2097763810',id=27,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHn6VY0TWifqU3p1evbu+EX6BdhcRbf171BBoRu2Zek2ZxhXI3fsfWd4X4kA8GA+fpWd9lKaJGwEU1M4JEXSRotTTW+C0bM2tFJUQlcVplgUGzjC/IH04gthMYmR1rcXA==',key_name='tempest-keypair-2085079067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06966e2f4d3a4dec92282c7ad348635d',ramdisk_id='',reservation_id='r-ju2ed407',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-303418642',owner_user_name='tempest-AttachVolumeNegativeTest-303418642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d405421ceb4d99967ef2e7f55e7809',uuid=e6e3640a-c262-4e2d-a994-2e4312f22871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "183a0478-c117-4fe1-acce-22e4aee440c9", "address": "fa:16:3e:6c:3e:6d", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183a0478-c1", "ovs_interfaceid": "183a0478-c117-4fe1-acce-22e4aee440c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converting VIF {"id": "183a0478-c117-4fe1-acce-22e4aee440c9", "address": "fa:16:3e:6c:3e:6d", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183a0478-c1", "ovs_interfaceid": "183a0478-c117-4fe1-acce-22e4aee440c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3e:6d,bridge_name='br-int',has_traffic_filtering=True,id=183a0478-c117-4fe1-acce-22e4aee440c9,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183a0478-c1') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.objects.instance [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'pci_devices' on Instance uuid e6e3640a-c262-4e2d-a994-2e4312f22871 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:32:07 user nova-compute[82196]:   <uuid>e6e3640a-c262-4e2d-a994-2e4312f22871</uuid>
Apr 11 19:32:07 user nova-compute[82196]:   <name>instance-0000001b</name>
Apr 11 19:32:07 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:32:07 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:32:07 user nova-compute[82196]:   <metadata>
Apr 11 19:32:07 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:32:07 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:32:07 user nova-compute[82196]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2097763810</nova:name>
Apr 11 19:32:07 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:32:07</nova:creationTime>
Apr 11 19:32:07 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:32:07 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:32:07 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:32:07 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:32:07 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:32:07 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:32:07 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:32:07 user nova-compute[82196]:       <nova:owner>
Apr 11 19:32:07 user nova-compute[82196]:         <nova:user uuid="d5d405421ceb4d99967ef2e7f55e7809">tempest-AttachVolumeNegativeTest-303418642-project-member</nova:user>
Apr 11 19:32:07 user nova-compute[82196]:         <nova:project uuid="06966e2f4d3a4dec92282c7ad348635d">tempest-AttachVolumeNegativeTest-303418642</nova:project>
Apr 11 19:32:07 user nova-compute[82196]:       </nova:owner>
Apr 11 19:32:07 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:32:07 user nova-compute[82196]:       <nova:ports>
Apr 11 19:32:07 user nova-compute[82196]:         <nova:port uuid="183a0478-c117-4fe1-acce-22e4aee440c9">
Apr 11 19:32:07 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:32:07 user nova-compute[82196]:         </nova:port>
Apr 11 19:32:07 user nova-compute[82196]:       </nova:ports>
Apr 11 19:32:07 user nova-compute[82196]:     </nova:instance>
Apr 11 19:32:07 user nova-compute[82196]:   </metadata>
Apr 11 19:32:07 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:32:07 user nova-compute[82196]:     <system>
Apr 11 19:32:07 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:32:07 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:32:07 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:32:07 user nova-compute[82196]:       <entry name="serial">e6e3640a-c262-4e2d-a994-2e4312f22871</entry>
Apr 11 19:32:07 user nova-compute[82196]:       <entry name="uuid">e6e3640a-c262-4e2d-a994-2e4312f22871</entry>
Apr 11 19:32:07 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:32:07 user nova-compute[82196]:     </system>
Apr 11 19:32:07 user nova-compute[82196]:   </sysinfo>
Apr 11 19:32:07 user nova-compute[82196]:   <os>
Apr 11 19:32:07 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:32:07 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:32:07 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:32:07 user nova-compute[82196]:   </os>
Apr 11 19:32:07 user nova-compute[82196]:   <features>
Apr 11 19:32:07 user nova-compute[82196]:     <acpi/>
Apr 11 19:32:07 user nova-compute[82196]:     <apic/>
Apr 11 19:32:07 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:32:07 user nova-compute[82196]:   </features>
Apr 11 19:32:07 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:32:07 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:32:07 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:32:07 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:32:07 user nova-compute[82196]:   </clock>
Apr 11 19:32:07 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:32:07 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:32:07 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:32:07 user nova-compute[82196]:   </cpu>
Apr 11 19:32:07 user nova-compute[82196]:   <devices>
Apr 11 19:32:07 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:32:07 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:32:07 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk"/>
Apr 11 19:32:07 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:32:07 user nova-compute[82196]:     </disk>
Apr 11 19:32:07 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:32:07 user nova-compute[82196]:       <mac address="fa:16:3e:6c:3e:6d"/>
Apr 11 19:32:07 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:32:07 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:32:07 user nova-compute[82196]:       <target dev="tap183a0478-c1"/>
Apr 11 19:32:07 user nova-compute[82196]:     </interface>
Apr 11 19:32:07 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:32:07 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/console.log" append="off"/>
Apr 11 19:32:07 user nova-compute[82196]:     </serial>
Apr 11 19:32:07 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:32:07 user nova-compute[82196]:     <video>
Apr 11 19:32:07 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:32:07 user nova-compute[82196]:     </video>
Apr 11 19:32:07 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:32:07 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:32:07 user nova-compute[82196]:     </rng>
Apr 11 19:32:07 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:32:07 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:32:07 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:32:07 user nova-compute[82196]:     </memballoon>
Apr 11 19:32:07 user nova-compute[82196]:   </devices>
Apr 11 19:32:07 user nova-compute[82196]: </domain>
Apr 11 19:32:07 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2097763810',display_name='tempest-AttachVolumeNegativeTest-server-2097763810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2097763810',id=27,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHn6VY0TWifqU3p1evbu+EX6BdhcRbf171BBoRu2Zek2ZxhXI3fsfWd4X4kA8GA+fpWd9lKaJGwEU1M4JEXSRotTTW+C0bM2tFJUQlcVplgUGzjC/IH04gthMYmR1rcXA==',key_name='tempest-keypair-2085079067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06966e2f4d3a4dec92282c7ad348635d',ramdisk_id='',reservation_id='r-ju2ed407',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-303418642',owner_user_name='tempest-AttachVolumeNegativeTest-303418642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d405421ceb4d99967ef2e7f55e7809',uuid=e6e3640a-c262-4e2d-a994-2e4312f22871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "183a0478-c117-4fe1-acce-22e4aee440c9", "address": "fa:16:3e:6c:3e:6d", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183a0478-c1", "ovs_interfaceid": "183a0478-c117-4fe1-acce-22e4aee440c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converting VIF {"id": "183a0478-c117-4fe1-acce-22e4aee440c9", "address": "fa:16:3e:6c:3e:6d", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183a0478-c1", "ovs_interfaceid": "183a0478-c117-4fe1-acce-22e4aee440c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3e:6d,bridge_name='br-int',has_traffic_filtering=True,id=183a0478-c117-4fe1-acce-22e4aee440c9,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183a0478-c1') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG os_vif [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3e:6d,bridge_name='br-int',has_traffic_filtering=True,id=183a0478-c117-4fe1-acce-22e4aee440c9,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183a0478-c1') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap183a0478-c1, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap183a0478-c1, col_values=(('external_ids', {'iface-id': '183a0478-c117-4fe1-acce-22e4aee440c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:3e:6d', 'vm-uuid': 'e6e3640a-c262-4e2d-a994-2e4312f22871'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:07 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:08 user nova-compute[82196]: INFO os_vif [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:3e:6d,bridge_name='br-int',has_traffic_filtering=True,id=183a0478-c117-4fe1-acce-22e4aee440c9,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183a0478-c1')
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No VIF found with MAC fa:16:3e:6c:3e:6d, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.network.neutron [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Successfully updated port: 2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "refresh_cache-03bb985c-4903-4d0e-98a1-43a9352f4ec6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquired lock "refresh_cache-03bb985c-4903-4d0e-98a1-43a9352f4ec6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.network.neutron [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.compute.manager [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Received event network-changed-2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.compute.manager [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Refreshing instance network info cache due to event network-changed-2da07e24-d185-4553-ab56-819067f03d48. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] Acquiring lock "refresh_cache-03bb985c-4903-4d0e-98a1-43a9352f4ec6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.network.neutron [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.network.neutron [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Updated VIF entry in instance network info cache for port 183a0478-c117-4fe1-acce-22e4aee440c9. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.network.neutron [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Updating instance_info_cache with network_info: [{"id": "183a0478-c117-4fe1-acce-22e4aee440c9", "address": "fa:16:3e:6c:3e:6d", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183a0478-c1", "ovs_interfaceid": "183a0478-c117-4fe1-acce-22e4aee440c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e0b9a0c4-4e09-41e8-b5c0-03d3091a7334 req-ad0e76e0-7585-4ccd-a740-5822f5aaf898 service nova] Releasing lock "refresh_cache-e6e3640a-c262-4e2d-a994-2e4312f22871" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.network.neutron [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Updating instance_info_cache with network_info: [{"id": "2da07e24-d185-4553-ab56-819067f03d48", "address": "fa:16:3e:e5:31:c4", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da07e24-d1", "ovs_interfaceid": "2da07e24-d185-4553-ab56-819067f03d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Releasing lock "refresh_cache-03bb985c-4903-4d0e-98a1-43a9352f4ec6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Instance network_info: |[{"id": "2da07e24-d185-4553-ab56-819067f03d48", "address": "fa:16:3e:e5:31:c4", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da07e24-d1", "ovs_interfaceid": "2da07e24-d185-4553-ab56-819067f03d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] Acquired lock "refresh_cache-03bb985c-4903-4d0e-98a1-43a9352f4ec6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.network.neutron [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Refreshing network info cache for port 2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Start _get_guest_xml network_info=[{"id": "2da07e24-d185-4553-ab56-819067f03d48", "address": "fa:16:3e:e5:31:c4", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da07e24-d1", "ovs_interfaceid": "2da07e24-d185-4553-ab56-819067f03d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:32:08 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:32:08 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1542491412',display_name='tempest-VolumesSnapshotTestJSON-instance-1542491412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1542491412',id=28,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d5246cf04a7401388cba38d16e298ae',ramdisk_id='',reservation_id='r-o45jrj9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-111705993',owner_user_name='tempest-VolumesSnapshotTestJSON-111705993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:32:07Z,user_data=None,user_id='20f337feb0ed4653976ace530bfdd877',uuid=03bb985c-4903-4d0e-98a1-43a9352f4ec6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2da07e24-d185-4553-ab56-819067f03d48", "address": "fa:16:3e:e5:31:c4", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da07e24-d1", "ovs_interfaceid": "2da07e24-d185-4553-ab56-819067f03d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Converting VIF {"id": "2da07e24-d185-4553-ab56-819067f03d48", "address": "fa:16:3e:e5:31:c4", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da07e24-d1", "ovs_interfaceid": "2da07e24-d185-4553-ab56-819067f03d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=2da07e24-d185-4553-ab56-819067f03d48,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da07e24-d1') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.objects.instance [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'pci_devices' on Instance uuid 03bb985c-4903-4d0e-98a1-43a9352f4ec6 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:32:08 user nova-compute[82196]:   <uuid>03bb985c-4903-4d0e-98a1-43a9352f4ec6</uuid>
Apr 11 19:32:08 user nova-compute[82196]:   <name>instance-0000001c</name>
Apr 11 19:32:08 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:32:08 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:32:08 user nova-compute[82196]:   <metadata>
Apr 11 19:32:08 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:32:08 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:32:08 user nova-compute[82196]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1542491412</nova:name>
Apr 11 19:32:08 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:32:08</nova:creationTime>
Apr 11 19:32:08 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:32:08 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:32:08 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:32:08 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:32:08 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:32:08 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:32:08 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:32:08 user nova-compute[82196]:       <nova:owner>
Apr 11 19:32:08 user nova-compute[82196]:         <nova:user uuid="20f337feb0ed4653976ace530bfdd877">tempest-VolumesSnapshotTestJSON-111705993-project-member</nova:user>
Apr 11 19:32:08 user nova-compute[82196]:         <nova:project uuid="6d5246cf04a7401388cba38d16e298ae">tempest-VolumesSnapshotTestJSON-111705993</nova:project>
Apr 11 19:32:08 user nova-compute[82196]:       </nova:owner>
Apr 11 19:32:08 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:32:08 user nova-compute[82196]:       <nova:ports>
Apr 11 19:32:08 user nova-compute[82196]:         <nova:port uuid="2da07e24-d185-4553-ab56-819067f03d48">
Apr 11 19:32:08 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 19:32:08 user nova-compute[82196]:         </nova:port>
Apr 11 19:32:08 user nova-compute[82196]:       </nova:ports>
Apr 11 19:32:08 user nova-compute[82196]:     </nova:instance>
Apr 11 19:32:08 user nova-compute[82196]:   </metadata>
Apr 11 19:32:08 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:32:08 user nova-compute[82196]:     <system>
Apr 11 19:32:08 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:32:08 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:32:08 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:32:08 user nova-compute[82196]:       <entry name="serial">03bb985c-4903-4d0e-98a1-43a9352f4ec6</entry>
Apr 11 19:32:08 user nova-compute[82196]:       <entry name="uuid">03bb985c-4903-4d0e-98a1-43a9352f4ec6</entry>
Apr 11 19:32:08 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:32:08 user nova-compute[82196]:     </system>
Apr 11 19:32:08 user nova-compute[82196]:   </sysinfo>
Apr 11 19:32:08 user nova-compute[82196]:   <os>
Apr 11 19:32:08 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:32:08 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:32:08 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:32:08 user nova-compute[82196]:   </os>
Apr 11 19:32:08 user nova-compute[82196]:   <features>
Apr 11 19:32:08 user nova-compute[82196]:     <acpi/>
Apr 11 19:32:08 user nova-compute[82196]:     <apic/>
Apr 11 19:32:08 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:32:08 user nova-compute[82196]:   </features>
Apr 11 19:32:08 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:32:08 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:32:08 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:32:08 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:32:08 user nova-compute[82196]:   </clock>
Apr 11 19:32:08 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:32:08 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:32:08 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:32:08 user nova-compute[82196]:   </cpu>
Apr 11 19:32:08 user nova-compute[82196]:   <devices>
Apr 11 19:32:08 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:32:08 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:32:08 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk"/>
Apr 11 19:32:08 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:32:08 user nova-compute[82196]:     </disk>
Apr 11 19:32:08 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:32:08 user nova-compute[82196]:       <mac address="fa:16:3e:e5:31:c4"/>
Apr 11 19:32:08 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:32:08 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:32:08 user nova-compute[82196]:       <target dev="tap2da07e24-d1"/>
Apr 11 19:32:08 user nova-compute[82196]:     </interface>
Apr 11 19:32:08 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:32:08 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/console.log" append="off"/>
Apr 11 19:32:08 user nova-compute[82196]:     </serial>
Apr 11 19:32:08 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:32:08 user nova-compute[82196]:     <video>
Apr 11 19:32:08 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:32:08 user nova-compute[82196]:     </video>
Apr 11 19:32:08 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:32:08 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:32:08 user nova-compute[82196]:     </rng>
Apr 11 19:32:08 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:32:08 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:32:08 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:32:08 user nova-compute[82196]:     </memballoon>
Apr 11 19:32:08 user nova-compute[82196]:   </devices>
Apr 11 19:32:08 user nova-compute[82196]: </domain>
Apr 11 19:32:08 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1542491412',display_name='tempest-VolumesSnapshotTestJSON-instance-1542491412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1542491412',id=28,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d5246cf04a7401388cba38d16e298ae',ramdisk_id='',reservation_id='r-o45jrj9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-111705993',owner_user_name='tempest-VolumesSnapshotTestJSON-111705993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:32:07Z,user_data=None,user_id='20f337feb0ed4653976ace530bfdd877',uuid=03bb985c-4903-4d0e-98a1-43a9352f4ec6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2da07e24-d185-4553-ab56-819067f03d48", "address": "fa:16:3e:e5:31:c4", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da07e24-d1", "ovs_interfaceid": "2da07e24-d185-4553-ab56-819067f03d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Converting VIF {"id": "2da07e24-d185-4553-ab56-819067f03d48", "address": "fa:16:3e:e5:31:c4", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da07e24-d1", "ovs_interfaceid": "2da07e24-d185-4553-ab56-819067f03d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=2da07e24-d185-4553-ab56-819067f03d48,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da07e24-d1') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG os_vif [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=2da07e24-d185-4553-ab56-819067f03d48,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da07e24-d1') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2da07e24-d1, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2da07e24-d1, col_values=(('external_ids', {'iface-id': '2da07e24-d185-4553-ab56-819067f03d48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:31:c4', 'vm-uuid': '03bb985c-4903-4d0e-98a1-43a9352f4ec6'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:08 user nova-compute[82196]: INFO os_vif [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=2da07e24-d185-4553-ab56-819067f03d48,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da07e24-d1')
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:32:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] No VIF found with MAC fa:16:3e:e5:31:c4, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:32:09 user nova-compute[82196]: INFO nova.compute.manager [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Unrescuing
Apr 11 19:32:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquired lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG nova.network.neutron [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Updated VIF entry in instance network info cache for port 2da07e24-d185-4553-ab56-819067f03d48. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG nova.network.neutron [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Updating instance_info_cache with network_info: [{"id": "2da07e24-d185-4553-ab56-819067f03d48", "address": "fa:16:3e:e5:31:c4", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da07e24-d1", "ovs_interfaceid": "2da07e24-d185-4553-ab56-819067f03d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7d047375-5403-46a7-bc47-e28e3479707f req-31421fa2-6ff2-4f21-9d39-ddd23eb89ccd service nova] Releasing lock "refresh_cache-03bb985c-4903-4d0e-98a1-43a9352f4ec6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Updating instance_info_cache with network_info: [{"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Releasing lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG nova.objects.instance [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'flavor' on Instance uuid 864fcd9b-8e5b-4de8-a2e6-292a8907a834 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:32:09 user nova-compute[82196]: INFO nova.compute.claims [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Claim successful on node user
Apr 11 19:32:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-3760b323-acd0-4e10-b29d-3fd84b907cbb req-c91e5535-5392-446b-b0f0-5ff54ffea01b service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Received event network-vif-plugged-183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3760b323-acd0-4e10-b29d-3fd84b907cbb req-c91e5535-5392-446b-b0f0-5ff54ffea01b service nova] Acquiring lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3760b323-acd0-4e10-b29d-3fd84b907cbb req-c91e5535-5392-446b-b0f0-5ff54ffea01b service nova] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3760b323-acd0-4e10-b29d-3fd84b907cbb req-c91e5535-5392-446b-b0f0-5ff54ffea01b service nova] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-3760b323-acd0-4e10-b29d-3fd84b907cbb req-c91e5535-5392-446b-b0f0-5ff54ffea01b service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] No waiting events found dispatching network-vif-plugged-183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:32:10 user nova-compute[82196]: WARNING nova.compute.manager [req-3760b323-acd0-4e10-b29d-3fd84b907cbb req-c91e5535-5392-446b-b0f0-5ff54ffea01b service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Received unexpected event network-vif-plugged-183a0478-c117-4fe1-acce-22e4aee440c9 for instance with vm_state building and task_state spawning.
Apr 11 19:32:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:32:10 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:32:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:32:10 user nova-compute[82196]: INFO nova.virt.block_device [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Booting with volume snapshot fadf1a5b-e35a-4680-a9c6-8aff9616539d at /dev/vda
Apr 11 19:32:10 user nova-compute[82196]: DEBUG nova.policy [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:11 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Instance destroyed successfully.
Apr 11 19:32:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Successfully created port: 07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:32:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-31bc1fef-1a28-41e1-a003-41dbfd385adf req-7237d81a-6bdd-4616-86c9-d752799c0d3a service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Received event network-vif-plugged-2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-31bc1fef-1a28-41e1-a003-41dbfd385adf req-7237d81a-6bdd-4616-86c9-d752799c0d3a service nova] Acquiring lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-31bc1fef-1a28-41e1-a003-41dbfd385adf req-7237d81a-6bdd-4616-86c9-d752799c0d3a service nova] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-31bc1fef-1a28-41e1-a003-41dbfd385adf req-7237d81a-6bdd-4616-86c9-d752799c0d3a service nova] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-31bc1fef-1a28-41e1-a003-41dbfd385adf req-7237d81a-6bdd-4616-86c9-d752799c0d3a service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] No waiting events found dispatching network-vif-plugged-2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:32:11 user nova-compute[82196]: WARNING nova.compute.manager [req-31bc1fef-1a28-41e1-a003-41dbfd385adf req-7237d81a-6bdd-4616-86c9-d752799c0d3a service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Received unexpected event network-vif-plugged-2da07e24-d185-4553-ab56-819067f03d48 for instance with vm_state building and task_state spawning.
Apr 11 19:32:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "720c683f-c03a-444c-92a8-daf97c9f524b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:11 user nova-compute[82196]: INFO nova.compute.manager [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Detaching volume b5f0471b-94d7-446d-9313-3c94d2e9355d
Apr 11 19:32:11 user nova-compute[82196]: INFO nova.virt.block_device [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Attempting to driver detach volume b5f0471b-94d7-446d-9313-3c94d2e9355d from mountpoint /dev/vdc
Apr 11 19:32:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Attempting to detach device vdc from instance 720c683f-c03a-444c-92a8-daf97c9f524b from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:32:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:32:11 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:32:11 user nova-compute[82196]:   <source dev="/dev/sdc"/>
Apr 11 19:32:11 user nova-compute[82196]:   <target dev="vdc" bus="virtio"/>
Apr 11 19:32:11 user nova-compute[82196]:   <serial>b5f0471b-94d7-446d-9313-3c94d2e9355d</serial>
Apr 11 19:32:11 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 19:32:11 user nova-compute[82196]: </disk>
Apr 11 19:32:11 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:32:11 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Successfully detached device vdc from instance 720c683f-c03a-444c-92a8-daf97c9f524b from the persistent domain config.
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 720c683f-c03a-444c-92a8-daf97c9f524b from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:32:12 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:32:12 user nova-compute[82196]:   <source dev="/dev/sdc"/>
Apr 11 19:32:12 user nova-compute[82196]:   <target dev="vdc" bus="virtio"/>
Apr 11 19:32:12 user nova-compute[82196]:   <serial>b5f0471b-94d7-446d-9313-3c94d2e9355d</serial>
Apr 11 19:32:12 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 19:32:12 user nova-compute[82196]: </disk>
Apr 11 19:32:12 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Received event network-vif-plugged-183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Acquiring lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] No waiting events found dispatching network-vif-plugged-183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:32:12 user nova-compute[82196]: WARNING nova.compute.manager [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Received unexpected event network-vif-plugged-183a0478-c117-4fe1-acce-22e4aee440c9 for instance with vm_state building and task_state spawning.
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-unplugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] No waiting events found dispatching network-vif-unplugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:32:12 user nova-compute[82196]: WARNING nova.compute.manager [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received unexpected event network-vif-unplugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] No waiting events found dispatching network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:32:12 user nova-compute[82196]: WARNING nova.compute.manager [req-8d73ef1b-aeac-47a7-90d4-44047064b173 req-862d328a-00bf-4870-ab7d-a63cd6fbda0c service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received unexpected event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Successfully updated port: 07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "refresh_cache-cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquired lock "refresh_cache-cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241532.8471801, 720c683f-c03a-444c-92a8-daf97c9f524b => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:32:12 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Successfully detached device vdc from instance 720c683f-c03a-444c-92a8-daf97c9f524b from the live domain config.
Apr 11 19:32:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VedmwTzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:32:12 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:32:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17b2ea2-7504-4e9f-b6ee-fa531a247401]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:32:12 user nova-compute[82196]: No targets found.
Apr 11 19:32:12 user nova-compute[82196]: iSNS:
Apr 11 19:32:12 user nova-compute[82196]: No targets found.
Apr 11 19:32:12 user nova-compute[82196]: STATIC:
Apr 11 19:32:12 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:32:12 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:32:12 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:32:12 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f
Apr 11 19:32:12 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:32:12 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:32:12 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d
Apr 11 19:32:12 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:32:12 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:32:12 user nova-compute[82196]: FIRMWARE:
Apr 11 19:32:12 user nova-compute[82196]: No targets found.
Apr 11 19:32:12 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:32:12 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:32:12 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6295f05e-902e-4db0-bb5f-233f9aedc362]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8adf31-6a48-46fd-a424-5333a4e9ca27]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:32:12 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:32:12 user nova-compute[82196]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:32:12 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:32:12 user nova-compute[82196]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d (non-flash)
Apr 11 19:32:12 user nova-compute[82196]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:32:12 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9274126cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d'): ({'sdc'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Removing single pathed devices sdc {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e2c302-d880-47c1-9355-d3ba8b7e4e5b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc951d25-66ae-4df2-a486-bddcf5bf7da2]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flushing IO for device /dev/sdc {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:32:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4056a93d-987c-4535-a020-7602d452689a]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241533.032778, e6e3640a-c262-4e2d-a994-2e4312f22871 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:32:13 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] VM Resumed (Lifecycle Event)
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:32:13 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Instance spawned successfully.
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9deb08-3132-41bb-992d-4b55ff79131d]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bad3d5-3f0d-48e5-9015-a9fd9b75537e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:13 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241533.0330362, e6e3640a-c262-4e2d-a994-2e4312f22871 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:32:13 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] VM Started (Lifecycle Event)
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a247dfaf-6839-49f1-8c18-c395469654e7]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d, portal: 172.16.0.220,3260]
Apr 11 19:32:13 user nova-compute[82196]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d, portal: 172.16.0.220,3260] successful.
Apr 11 19:32:13 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:13 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:32:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f0471b-94d7-446d-9313-3c94d2e9355d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda8dc22-8bb6-4a4f-a2ae-2493242048fd]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] <== disconnect_volume: return (335ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:32:13 user nova-compute[82196]: INFO nova.compute.manager [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Took 9.93 seconds to spawn the instance on the hypervisor.
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Updating instance_info_cache with network_info: [{"id": "07039db4-244e-4941-ae2b-5f396531e40d", "address": "fa:16:3e:a2:73:6f", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07039db4-24", "ovs_interfaceid": "07039db4-244e-4941-ae2b-5f396531e40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Releasing lock "refresh_cache-cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Instance network_info: |[{"id": "07039db4-244e-4941-ae2b-5f396531e40d", "address": "fa:16:3e:a2:73:6f", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07039db4-24", "ovs_interfaceid": "07039db4-244e-4941-ae2b-5f396531e40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:13 user nova-compute[82196]: INFO nova.compute.manager [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Took 10.64 seconds to build instance.
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1699e73-3d26-43b0-be90-603ea9245ff0 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.742s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Received event network-vif-plugged-2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] Acquiring lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] No waiting events found dispatching network-vif-plugged-2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:32:13 user nova-compute[82196]: WARNING nova.compute.manager [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Received unexpected event network-vif-plugged-2da07e24-d185-4553-ab56-819067f03d48 for instance with vm_state building and task_state spawning.
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Received event network-changed-07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Refreshing instance network info cache due to event network-changed-07039db4-244e-4941-ae2b-5f396531e40d. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] Acquiring lock "refresh_cache-cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] Acquired lock "refresh_cache-cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:32:13 user nova-compute[82196]: DEBUG nova.network.neutron [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Refreshing network info cache for port 07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] No waiting events found dispatching network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:32:14 user nova-compute[82196]: WARNING nova.compute.manager [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received unexpected event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:32:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] No waiting events found dispatching network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:32:14 user nova-compute[82196]: WARNING nova.compute.manager [req-a0b45943-8354-4fd1-9535-3dd9e7fd25c6 req-1fd157b6-294a-4169-bda2-95259e21db87 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received unexpected event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:32:14 user nova-compute[82196]: DEBUG nova.objects.instance [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'flavor' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-042b9b97-06c8-402a-b5d0-ea0424c73ef0 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "720c683f-c03a-444c-92a8-daf97c9f524b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.285s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG nova.network.neutron [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Updated VIF entry in instance network info cache for port 07039db4-244e-4941-ae2b-5f396531e40d. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG nova.network.neutron [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Updating instance_info_cache with network_info: [{"id": "07039db4-244e-4941-ae2b-5f396531e40d", "address": "fa:16:3e:a2:73:6f", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07039db4-24", "ovs_interfaceid": "07039db4-244e-4941-ae2b-5f396531e40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0a949fe5-0e67-4bac-8173-3a19782ed714 req-e792cd5f-8099-4453-a785-164a979b16d2 service nova] Releasing lock "refresh_cache-cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:32:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241535.147091, 03bb985c-4903-4d0e-98a1-43a9352f4ec6 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:32:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] VM Resumed (Lifecycle Event)
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:15 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Instance spawned successfully.
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:32:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241535.1503522, 03bb985c-4903-4d0e-98a1-43a9352f4ec6 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:32:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] VM Started (Lifecycle Event)
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:32:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:32:15 user nova-compute[82196]: INFO nova.compute.manager [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Took 8.43 seconds to spawn the instance on the hypervisor.
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:15 user nova-compute[82196]: INFO nova.compute.manager [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Took 9.21 seconds to build instance.
Apr 11 19:32:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442231f5-3c74-4b96-9f75-343062f0b2f0 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.310s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for 864fcd9b-8e5b-4de8-a2e6-292a8907a834 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241535.5615933, 864fcd9b-8e5b-4de8-a2e6-292a8907a834 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:32:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] VM Resumed (Lifecycle Event)
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-88ca11ef-79cc-497e-8068-5181fc5df695 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:32:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241535.5630884, 864fcd9b-8e5b-4de8-a2e6-292a8907a834 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:32:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] VM Started (Lifecycle Event)
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG os_brick.utils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f60f47-d019-4e10-ac90-c96458c42af4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9fe28-861d-4aa5-a1d9-883b1ac8b49b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac37412-1fcb-4049-9b9a-2e7192eff10f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a8a695-81d3-4e55-a34f-df752eb23414]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:32:16 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:32:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[09301b47-834b-493a-ad4d-8adccf527035]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG os_brick.utils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:32:16 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Updating existing volume attachment record: cdab03d5-f5fe-429b-8dad-ae0f823b5ec9 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:32:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:32:20 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Creating image(s)
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Ensure instance console log exists: /opt/stack/data/nova/instances/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Start _get_guest_xml network_info=[{"id": "07039db4-244e-4941-ae2b-5f396531e40d", "address": "fa:16:3e:a2:73:6f", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07039db4-24", "ovs_interfaceid": "07039db4-244e-4941-ae2b-5f396531e40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYUbieSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08', 'attached_at': '', 'detached_at': '', 'volume_id': '88788728-a3d3-4402-b948-5c1beec86f92', 'serial': '88788728-a3d3-4402-b948-5c1beec86f92'}, 'attachment_id': 'cdab03d5-f5fe-429b-8dad-ae0f823b5ec9', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:32:20 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:32:20 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYUbieSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:32:20 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:32:20 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:32:20 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a191ffc-bf66-45bc-a70e-4a623eaeda9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:32:20 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e012d36-96a4-4939-8de6-95d70230549f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92] added
Apr 11 19:32:20 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b66c35c-8958-48cd-97de-011749a0ec67]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65413e6-c8db-4b92-9c74-c2b5eec45231]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYUbieSO {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYUbieSO" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fe5206-bbeb-4319-9691-e70d0ffa32fc]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lYUbieSO'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c652b04-0914-4819-a58b-1ed3142a638f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[487745ef-bc87-404a-8869-26faa15fcf60]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:32:20 user nova-compute[82196]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:32:20 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:32:20 user nova-compute[82196]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:32:20 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e323ff0-48c0-4d31-94f8-a1bb4a61e79b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92, portal: 172.16.0.220,3260]
Apr 11 19:32:20 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92, portal: 172.16.0.220,3260] successful.
Apr 11 19:32:20 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[38078301-31d4-4d5d-9933-e2a9c93451e0]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:32:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de15a51-eed3-4220-997b-676b0ad0a5be]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:32:21 user nova-compute[82196]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:32:21 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:32:21 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:32:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:32:21 user nova-compute[82196]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:32:21 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:32:21 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:32:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:32:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:32:21 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:32:21 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:32:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7421a8d5-4615-408d-8653-80f10d5e3282]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:32:21 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYUbieSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23666646635626363', 'path': '/dev/sdc'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666646635626363', 'path': '/dev/sdc'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1884458262',display_name='tempest-TestVolumeBootPattern-server-1884458262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1884458262',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-b1o37gxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:32:11Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07039db4-244e-4941-ae2b-5f396531e40d", "address": "fa:16:3e:a2:73:6f", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07039db4-24", "ovs_interfaceid": "07039db4-244e-4941-ae2b-5f396531e40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "07039db4-244e-4941-ae2b-5f396531e40d", "address": "fa:16:3e:a2:73:6f", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07039db4-24", "ovs_interfaceid": "07039db4-244e-4941-ae2b-5f396531e40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=07039db4-244e-4941-ae2b-5f396531e40d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07039db4-24') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lazy-loading 'pci_devices' on Instance uuid cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:32:22 user nova-compute[82196]:   <uuid>cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08</uuid>
Apr 11 19:32:22 user nova-compute[82196]:   <name>instance-0000001d</name>
Apr 11 19:32:22 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:32:22 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:32:22 user nova-compute[82196]:   <metadata>
Apr 11 19:32:22 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:32:22 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:32:22 user nova-compute[82196]:       <nova:name>tempest-TestVolumeBootPattern-server-1884458262</nova:name>
Apr 11 19:32:22 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:32:20</nova:creationTime>
Apr 11 19:32:22 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:32:22 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:32:22 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:32:22 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:32:22 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:32:22 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:32:22 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:32:22 user nova-compute[82196]:       <nova:owner>
Apr 11 19:32:22 user nova-compute[82196]:         <nova:user uuid="cf262cd03f4a41c4956d8784cf37d86d">tempest-TestVolumeBootPattern-935343500-project-member</nova:user>
Apr 11 19:32:22 user nova-compute[82196]:         <nova:project uuid="2caba0618fc743e7bfb2dd866a511df9">tempest-TestVolumeBootPattern-935343500</nova:project>
Apr 11 19:32:22 user nova-compute[82196]:       </nova:owner>
Apr 11 19:32:22 user nova-compute[82196]:       <nova:ports>
Apr 11 19:32:22 user nova-compute[82196]:         <nova:port uuid="07039db4-244e-4941-ae2b-5f396531e40d">
Apr 11 19:32:22 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 19:32:22 user nova-compute[82196]:         </nova:port>
Apr 11 19:32:22 user nova-compute[82196]:       </nova:ports>
Apr 11 19:32:22 user nova-compute[82196]:     </nova:instance>
Apr 11 19:32:22 user nova-compute[82196]:   </metadata>
Apr 11 19:32:22 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:32:22 user nova-compute[82196]:     <system>
Apr 11 19:32:22 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:32:22 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:32:22 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:32:22 user nova-compute[82196]:       <entry name="serial">cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08</entry>
Apr 11 19:32:22 user nova-compute[82196]:       <entry name="uuid">cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08</entry>
Apr 11 19:32:22 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:32:22 user nova-compute[82196]:     </system>
Apr 11 19:32:22 user nova-compute[82196]:   </sysinfo>
Apr 11 19:32:22 user nova-compute[82196]:   <os>
Apr 11 19:32:22 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:32:22 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:32:22 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:32:22 user nova-compute[82196]:   </os>
Apr 11 19:32:22 user nova-compute[82196]:   <features>
Apr 11 19:32:22 user nova-compute[82196]:     <acpi/>
Apr 11 19:32:22 user nova-compute[82196]:     <apic/>
Apr 11 19:32:22 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:32:22 user nova-compute[82196]:   </features>
Apr 11 19:32:22 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:32:22 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:32:22 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:32:22 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:32:22 user nova-compute[82196]:   </clock>
Apr 11 19:32:22 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:32:22 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:32:22 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:32:22 user nova-compute[82196]:   </cpu>
Apr 11 19:32:22 user nova-compute[82196]:   <devices>
Apr 11 19:32:22 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:32:22 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:32:22 user nova-compute[82196]:       <source dev="/dev/sdc"/>
Apr 11 19:32:22 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:32:22 user nova-compute[82196]:       <serial>88788728-a3d3-4402-b948-5c1beec86f92</serial>
Apr 11 19:32:22 user nova-compute[82196]:     </disk>
Apr 11 19:32:22 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:32:22 user nova-compute[82196]:       <mac address="fa:16:3e:a2:73:6f"/>
Apr 11 19:32:22 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:32:22 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:32:22 user nova-compute[82196]:       <target dev="tap07039db4-24"/>
Apr 11 19:32:22 user nova-compute[82196]:     </interface>
Apr 11 19:32:22 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:32:22 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08/console.log" append="off"/>
Apr 11 19:32:22 user nova-compute[82196]:     </serial>
Apr 11 19:32:22 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:32:22 user nova-compute[82196]:     <video>
Apr 11 19:32:22 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:32:22 user nova-compute[82196]:     </video>
Apr 11 19:32:22 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:32:22 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:32:22 user nova-compute[82196]:     </rng>
Apr 11 19:32:22 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:32:22 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:32:22 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:32:22 user nova-compute[82196]:     </memballoon>
Apr 11 19:32:22 user nova-compute[82196]:   </devices>
Apr 11 19:32:22 user nova-compute[82196]: </domain>
Apr 11 19:32:22 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1884458262',display_name='tempest-TestVolumeBootPattern-server-1884458262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1884458262',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-b1o37gxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:32:11Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07039db4-244e-4941-ae2b-5f396531e40d", "address": "fa:16:3e:a2:73:6f", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07039db4-24", "ovs_interfaceid": "07039db4-244e-4941-ae2b-5f396531e40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "07039db4-244e-4941-ae2b-5f396531e40d", "address": "fa:16:3e:a2:73:6f", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07039db4-24", "ovs_interfaceid": "07039db4-244e-4941-ae2b-5f396531e40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=07039db4-244e-4941-ae2b-5f396531e40d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07039db4-24') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG os_vif [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=07039db4-244e-4941-ae2b-5f396531e40d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07039db4-24') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07039db4-24, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07039db4-24, col_values=(('external_ids', {'iface-id': '07039db4-244e-4941-ae2b-5f396531e40d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:73:6f', 'vm-uuid': 'cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:22 user nova-compute[82196]: INFO os_vif [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=07039db4-244e-4941-ae2b-5f396531e40d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07039db4-24')
Apr 11 19:32:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:32:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] No VIF found with MAC fa:16:3e:a2:73:6f, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:32:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:23 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:32:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquired lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:32:23 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:32:23 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'info_cache' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-56575115-e408-412b-a370-805e0201647e req-5e898cee-0e5c-4176-8e8d-bb06001f5a26 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Received event network-vif-plugged-07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-56575115-e408-412b-a370-805e0201647e req-5e898cee-0e5c-4176-8e8d-bb06001f5a26 service nova] Acquiring lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-56575115-e408-412b-a370-805e0201647e req-5e898cee-0e5c-4176-8e8d-bb06001f5a26 service nova] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-56575115-e408-412b-a370-805e0201647e req-5e898cee-0e5c-4176-8e8d-bb06001f5a26 service nova] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-56575115-e408-412b-a370-805e0201647e req-5e898cee-0e5c-4176-8e8d-bb06001f5a26 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] No waiting events found dispatching network-vif-plugged-07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:32:24 user nova-compute[82196]: WARNING nova.compute.manager [req-56575115-e408-412b-a370-805e0201647e req-5e898cee-0e5c-4176-8e8d-bb06001f5a26 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Received unexpected event network-vif-plugged-07039db4-244e-4941-ae2b-5f396531e40d for instance with vm_state building and task_state spawning.
Apr 11 19:32:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Updating instance_info_cache with network_info: [{"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Releasing lock "refresh_cache-6802f099-9236-4c79-a892-2963f1b15b0e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:32:25 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance destroyed successfully.
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'resources' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1133297397',display_name='tempest-AttachVolumeTestJSON-server-1133297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1133297397',id=15,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOPD4tcuauGjUTVAuhtjF6Ujtk7F6BaqU+NEO4mmGMGLvyjwNgcmLISc53y0YOwfDCzVZpJizbGjjXjSyz46Q14bi5LzbNBxPb/IJFa2O26n4+/fWcXb8RJ3mMBruboVA==',key_name='tempest-keypair-1431410116',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d886d2ec5fc946b49af3c8ca7c8556c7',ramdisk_id='',reservation_id='r-57smpzsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2144032498',owner_user_name='tempest-AttachVolumeTestJSON-2144032498-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:30:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31c237e142784bd6aa460d6f1bf33400',uuid=6802f099-9236-4c79-a892-2963f1b15b0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converting VIF {"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG os_vif [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6193819b-0c, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:32:25 user nova-compute[82196]: INFO os_vif [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c')
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Start _get_guest_xml network_info=[{"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'numa_topology' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:25 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:32:25 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1133297397',display_name='tempest-AttachVolumeTestJSON-server-1133297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1133297397',id=15,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOPD4tcuauGjUTVAuhtjF6Ujtk7F6BaqU+NEO4mmGMGLvyjwNgcmLISc53y0YOwfDCzVZpJizbGjjXjSyz46Q14bi5LzbNBxPb/IJFa2O26n4+/fWcXb8RJ3mMBruboVA==',key_name='tempest-keypair-1431410116',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d886d2ec5fc946b49af3c8ca7c8556c7',ramdisk_id='',reservation_id='r-57smpzsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2144032498',owner_user_name='tempest-AttachVolumeTestJSON-2144032498-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:30:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31c237e142784bd6aa460d6f1bf33400',uuid=6802f099-9236-4c79-a892-2963f1b15b0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converting VIF {"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'pci_devices' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:32:25 user nova-compute[82196]:   <uuid>6802f099-9236-4c79-a892-2963f1b15b0e</uuid>
Apr 11 19:32:25 user nova-compute[82196]:   <name>instance-0000000f</name>
Apr 11 19:32:25 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:32:25 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:32:25 user nova-compute[82196]:   <metadata>
Apr 11 19:32:25 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:32:25 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:32:25 user nova-compute[82196]:       <nova:name>tempest-AttachVolumeTestJSON-server-1133297397</nova:name>
Apr 11 19:32:25 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:32:25</nova:creationTime>
Apr 11 19:32:25 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:32:25 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:32:25 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:32:25 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:32:25 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:32:25 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:32:25 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:32:25 user nova-compute[82196]:       <nova:owner>
Apr 11 19:32:25 user nova-compute[82196]:         <nova:user uuid="31c237e142784bd6aa460d6f1bf33400">tempest-AttachVolumeTestJSON-2144032498-project-member</nova:user>
Apr 11 19:32:25 user nova-compute[82196]:         <nova:project uuid="d886d2ec5fc946b49af3c8ca7c8556c7">tempest-AttachVolumeTestJSON-2144032498</nova:project>
Apr 11 19:32:25 user nova-compute[82196]:       </nova:owner>
Apr 11 19:32:25 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:32:25 user nova-compute[82196]:       <nova:ports>
Apr 11 19:32:25 user nova-compute[82196]:         <nova:port uuid="6193819b-0c1b-476b-b89e-dbbfc7938fc5">
Apr 11 19:32:25 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 19:32:25 user nova-compute[82196]:         </nova:port>
Apr 11 19:32:25 user nova-compute[82196]:       </nova:ports>
Apr 11 19:32:25 user nova-compute[82196]:     </nova:instance>
Apr 11 19:32:25 user nova-compute[82196]:   </metadata>
Apr 11 19:32:25 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:32:25 user nova-compute[82196]:     <system>
Apr 11 19:32:25 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:32:25 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:32:25 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:32:25 user nova-compute[82196]:       <entry name="serial">6802f099-9236-4c79-a892-2963f1b15b0e</entry>
Apr 11 19:32:25 user nova-compute[82196]:       <entry name="uuid">6802f099-9236-4c79-a892-2963f1b15b0e</entry>
Apr 11 19:32:25 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:32:25 user nova-compute[82196]:     </system>
Apr 11 19:32:25 user nova-compute[82196]:   </sysinfo>
Apr 11 19:32:25 user nova-compute[82196]:   <os>
Apr 11 19:32:25 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:32:25 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:32:25 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:32:25 user nova-compute[82196]:   </os>
Apr 11 19:32:25 user nova-compute[82196]:   <features>
Apr 11 19:32:25 user nova-compute[82196]:     <acpi/>
Apr 11 19:32:25 user nova-compute[82196]:     <apic/>
Apr 11 19:32:25 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:32:25 user nova-compute[82196]:   </features>
Apr 11 19:32:25 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:32:25 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:32:25 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:32:25 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:32:25 user nova-compute[82196]:   </clock>
Apr 11 19:32:25 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:32:25 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:32:25 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:32:25 user nova-compute[82196]:   </cpu>
Apr 11 19:32:25 user nova-compute[82196]:   <devices>
Apr 11 19:32:25 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:32:25 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:32:25 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk"/>
Apr 11 19:32:25 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:32:25 user nova-compute[82196]:     </disk>
Apr 11 19:32:25 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:32:25 user nova-compute[82196]:       <mac address="fa:16:3e:ce:17:72"/>
Apr 11 19:32:25 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:32:25 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:32:25 user nova-compute[82196]:       <target dev="tap6193819b-0c"/>
Apr 11 19:32:25 user nova-compute[82196]:     </interface>
Apr 11 19:32:25 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:32:25 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/console.log" append="off"/>
Apr 11 19:32:25 user nova-compute[82196]:     </serial>
Apr 11 19:32:25 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:32:25 user nova-compute[82196]:     <video>
Apr 11 19:32:25 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:32:25 user nova-compute[82196]:     </video>
Apr 11 19:32:25 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:32:25 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:32:25 user nova-compute[82196]:     </rng>
Apr 11 19:32:25 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:32:25 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:32:25 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:32:25 user nova-compute[82196]:     </memballoon>
Apr 11 19:32:25 user nova-compute[82196]:   </devices>
Apr 11 19:32:25 user nova-compute[82196]: </domain>
Apr 11 19:32:25 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Cannot resize image /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'migration_context' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1133297397',display_name='tempest-AttachVolumeTestJSON-server-1133297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1133297397',id=15,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOPD4tcuauGjUTVAuhtjF6Ujtk7F6BaqU+NEO4mmGMGLvyjwNgcmLISc53y0YOwfDCzVZpJizbGjjXjSyz46Q14bi5LzbNBxPb/IJFa2O26n4+/fWcXb8RJ3mMBruboVA==',key_name='tempest-keypair-1431410116',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d886d2ec5fc946b49af3c8ca7c8556c7',ramdisk_id='',reservation_id='r-57smpzsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2144032498',owner_user_name='tempest-AttachVolumeTestJSON-2144032498-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:30:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31c237e142784bd6aa460d6f1bf33400',uuid=6802f099-9236-4c79-a892-2963f1b15b0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:32:25 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converting VIF {"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG os_vif [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6193819b-0c, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6193819b-0c, col_values=(('external_ids', {'iface-id': '6193819b-0c1b-476b-b89e-dbbfc7938fc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:17:72', 'vm-uuid': '6802f099-9236-4c79-a892-2963f1b15b0e'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:26 user nova-compute[82196]: INFO os_vif [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c')
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241546.0713627, cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:32:26 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] VM Resumed (Lifecycle Event)
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:32:26 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Instance spawned successfully.
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:32:26 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241546.0760877, cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:32:26 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] VM Started (Lifecycle Event)
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-a1c07c50-f0f8-4a48-a5c8-0326bb2d5c2c req-3a05dbbb-87d3-42c3-a61a-88be1041f262 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Received event network-vif-plugged-07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a1c07c50-f0f8-4a48-a5c8-0326bb2d5c2c req-3a05dbbb-87d3-42c3-a61a-88be1041f262 service nova] Acquiring lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a1c07c50-f0f8-4a48-a5c8-0326bb2d5c2c req-3a05dbbb-87d3-42c3-a61a-88be1041f262 service nova] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a1c07c50-f0f8-4a48-a5c8-0326bb2d5c2c req-3a05dbbb-87d3-42c3-a61a-88be1041f262 service nova] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-a1c07c50-f0f8-4a48-a5c8-0326bb2d5c2c req-3a05dbbb-87d3-42c3-a61a-88be1041f262 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] No waiting events found dispatching network-vif-plugged-07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:32:26 user nova-compute[82196]: WARNING nova.compute.manager [req-a1c07c50-f0f8-4a48-a5c8-0326bb2d5c2c req-3a05dbbb-87d3-42c3-a61a-88be1041f262 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Received unexpected event network-vif-plugged-07039db4-244e-4941-ae2b-5f396531e40d for instance with vm_state building and task_state spawning.
Apr 11 19:32:26 user nova-compute[82196]: INFO nova.compute.manager [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Took 5.51 seconds to spawn the instance on the hypervisor.
Apr 11 19:32:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:26 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:32:26 user nova-compute[82196]: INFO nova.compute.manager [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Took 16.36 seconds to build instance.
Apr 11 19:32:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4b6e035f-ec6e-416c-849d-8abc3d3b8e24 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.472s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] No waiting events found dispatching network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:32:28 user nova-compute[82196]: WARNING nova.compute.manager [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received unexpected event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance with vm_state stopped and task_state powering-on.
Apr 11 19:32:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] No waiting events found dispatching network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:32:28 user nova-compute[82196]: WARNING nova.compute.manager [req-a3693abd-304d-4d25-beca-c8a2afee6a4f req-9cca91e4-dc2b-47a4-9f95-83f16be25699 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received unexpected event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance with vm_state stopped and task_state powering-on.
Apr 11 19:32:29 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241549.7208414, 6802f099-9236-4c79-a892-2963f1b15b0e => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:32:29 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] VM Resumed (Lifecycle Event)
Apr 11 19:32:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:32:29 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance rebooted successfully.
Apr 11 19:32:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4e96e951-32a3-4bcf-b958-c0267bfbd97e tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:32:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:29 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 19:32:29 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241549.7218385, 6802f099-9236-4c79-a892-2963f1b15b0e => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:32:29 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] VM Started (Lifecycle Event)
Apr 11 19:32:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:32:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:32:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:36 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:32:38 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:32:39 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:32:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:32:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updating instance_info_cache with network_info: [{"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-720c683f-c03a-444c-92a8-daf97c9f524b" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] There are 0 instances to clean {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:32:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82196) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 19:32:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:32:43 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:32:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:43 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:32:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:43 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:32:46 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:32:46 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7626MB free_disk=26.272438049316406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6802f099-9236-4c79-a892-2963f1b15b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 720c683f-c03a-444c-92a8-daf97c9f524b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance e6e3640a-c262-4e2d-a994-2e4312f22871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing inventories for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Updating ProviderTree inventory for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Updating inventory in ProviderTree for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing aggregate associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, aggregates: None {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 19:32:46 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing trait associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 19:32:47 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:32:47 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:32:47 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:32:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:32:49 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:32:49 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:32:49 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:32:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:32:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "720c683f-c03a-444c-92a8-daf97c9f524b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:02 user nova-compute[82196]: INFO nova.compute.manager [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Terminating instance
Apr 11 19:33:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-7bc691fa-c1f6-4089-b2d1-0a72ffd2d9cd req-6c811fa2-444d-4d68-ada6-f0719603e67b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-vif-unplugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7bc691fa-c1f6-4089-b2d1-0a72ffd2d9cd req-6c811fa2-444d-4d68-ada6-f0719603e67b service nova] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7bc691fa-c1f6-4089-b2d1-0a72ffd2d9cd req-6c811fa2-444d-4d68-ada6-f0719603e67b service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7bc691fa-c1f6-4089-b2d1-0a72ffd2d9cd req-6c811fa2-444d-4d68-ada6-f0719603e67b service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-7bc691fa-c1f6-4089-b2d1-0a72ffd2d9cd req-6c811fa2-444d-4d68-ada6-f0719603e67b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] No waiting events found dispatching network-vif-unplugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-7bc691fa-c1f6-4089-b2d1-0a72ffd2d9cd req-6c811fa2-444d-4d68-ada6-f0719603e67b service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-vif-unplugged-9e6087aa-464a-450d-bd04-2653d9420094 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:33:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:02 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Instance destroyed successfully.
Apr 11 19:33:02 user nova-compute[82196]: DEBUG nova.objects.instance [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'resources' on Instance uuid 720c683f-c03a-444c-92a8-daf97c9f524b {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:33:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1219064691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1219064691',id=20,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ82RBzB/1/A3FnM1xLWpDXU/zavewAraCLhBOFMjSAT73wEadTAAV/T3F8H/2XBNIlxPBMghQi8EI/lCPJr4+3PB4NLUhilDnSU8CjIwDu129bM+5w7HZBo//kKOchz0Q==',key_name='tempest-keypair-787762884',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:30:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d8b189667e34931aa36149620a036e1',ramdisk_id='',reservation_id='r-qvcxbxdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-427928846',owner_user_name='tempest-AttachVolumeShelveTestJSON-427928846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:30:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0558ba5a2b04d36ba2f2411090cc4e4',uuid=720c683f-c03a-444c-92a8-daf97c9f524b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:33:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converting VIF {"id": "9e6087aa-464a-450d-bd04-2653d9420094", "address": "fa:16:3e:c8:24:ee", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6087aa-46", "ovs_interfaceid": "9e6087aa-464a-450d-bd04-2653d9420094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:33:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:33:03 user nova-compute[82196]: DEBUG os_vif [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:33:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e6087aa-46, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:33:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:03 user nova-compute[82196]: INFO os_vif [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=9e6087aa-464a-450d-bd04-2653d9420094,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6087aa-46')
Apr 11 19:33:03 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Deleting instance files /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b_del
Apr 11 19:33:03 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Deletion of /opt/stack/data/nova/instances/720c683f-c03a-444c-92a8-daf97c9f524b_del complete
Apr 11 19:33:03 user nova-compute[82196]: INFO nova.compute.manager [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 11 19:33:03 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:33:03 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:33:03 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:33:03 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:33:03 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Took 0.85 seconds to deallocate network for instance.
Apr 11 19:33:03 user nova-compute[82196]: DEBUG nova.compute.manager [req-695bd9fc-ee0f-4905-8c9a-727194576572 req-c05cfe50-0e7a-4ff2-86cf-4a49fa1bfbb4 service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-vif-deleted-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:33:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:04 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:33:04 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:33:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:04 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Deleted allocations for instance 720c683f-c03a-444c-92a8-daf97c9f524b
Apr 11 19:33:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-442f03e3-b458-438e-a067-436eeec9cfe2 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "720c683f-c03a-444c-92a8-daf97c9f524b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.211s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-19967530-5776-4031-b52a-31f96b6b1963 req-bb0d4ee3-4029-4ac4-8b85-a0148fdce4da service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received event network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:33:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-19967530-5776-4031-b52a-31f96b6b1963 req-bb0d4ee3-4029-4ac4-8b85-a0148fdce4da service nova] Acquiring lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-19967530-5776-4031-b52a-31f96b6b1963 req-bb0d4ee3-4029-4ac4-8b85-a0148fdce4da service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-19967530-5776-4031-b52a-31f96b6b1963 req-bb0d4ee3-4029-4ac4-8b85-a0148fdce4da service nova] Lock "720c683f-c03a-444c-92a8-daf97c9f524b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-19967530-5776-4031-b52a-31f96b6b1963 req-bb0d4ee3-4029-4ac4-8b85-a0148fdce4da service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] No waiting events found dispatching network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:33:04 user nova-compute[82196]: WARNING nova.compute.manager [req-19967530-5776-4031-b52a-31f96b6b1963 req-bb0d4ee3-4029-4ac4-8b85-a0148fdce4da service nova] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Received unexpected event network-vif-plugged-9e6087aa-464a-450d-bd04-2653d9420094 for instance with vm_state deleted and task_state None.
Apr 11 19:33:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:17 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241582.9807274, 720c683f-c03a-444c-92a8-daf97c9f524b => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:33:17 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] VM Stopped (Lifecycle Event)
Apr 11 19:33:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4306e748-bb27-464e-aa0f-3f7e0ebeef31 None None] [instance: 720c683f-c03a-444c-92a8-daf97c9f524b] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:33:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:35 user nova-compute[82196]: INFO nova.compute.manager [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Detaching volume 443c1e0d-cc51-400f-8525-c5352514ce7f
Apr 11 19:33:35 user nova-compute[82196]: INFO nova.virt.block_device [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Attempting to driver detach volume 443c1e0d-cc51-400f-8525-c5352514ce7f from mountpoint /dev/vdb
Apr 11 19:33:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Attempting to detach device vdb from instance 647674d8-af53-405a-8116-4b7a01549bdf from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:33:35 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:33:35 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:33:35 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:33:35 user nova-compute[82196]:   <serial>443c1e0d-cc51-400f-8525-c5352514ce7f</serial>
Apr 11 19:33:35 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 19:33:35 user nova-compute[82196]: </disk>
Apr 11 19:33:35 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:33:35 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully detached device vdb from instance 647674d8-af53-405a-8116-4b7a01549bdf from the persistent domain config.
Apr 11 19:33:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 647674d8-af53-405a-8116-4b7a01549bdf from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:33:35 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:33:35 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:33:35 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:33:35 user nova-compute[82196]:   <serial>443c1e0d-cc51-400f-8525-c5352514ce7f</serial>
Apr 11 19:33:35 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 19:33:35 user nova-compute[82196]: </disk>
Apr 11 19:33:35 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241615.7369878, 647674d8-af53-405a-8116-4b7a01549bdf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:33:35 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully detached device vdb from instance 647674d8-af53-405a-8116-4b7a01549bdf from the live domain config.
Apr 11 19:33:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLdgCADm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:33:35 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a134cca-846f-4d8d-8bce-4687ab2bf5f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:33:35 user nova-compute[82196]: No targets found.
Apr 11 19:33:35 user nova-compute[82196]: iSNS:
Apr 11 19:33:35 user nova-compute[82196]: No targets found.
Apr 11 19:33:35 user nova-compute[82196]: STATIC:
Apr 11 19:33:35 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:33:35 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:33:35 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:33:35 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f
Apr 11 19:33:35 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:33:35 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:33:35 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92
Apr 11 19:33:35 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:33:35 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:33:35 user nova-compute[82196]: FIRMWARE:
Apr 11 19:33:35 user nova-compute[82196]: No targets found.
Apr 11 19:33:35 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:33:35 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:33:35 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdb5c13-e63a-43f3-89f1-089934a716ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2935bcd-e5e3-4a15-a96a-e9059d926f5e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:33:35 user nova-compute[82196]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:33:35 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:33:35 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:33:35 user nova-compute[82196]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f (non-flash)
Apr 11 19:33:35 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:33:35 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927c1d0af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f'): ({'sdd'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Removing single pathed devices sdd {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae25f18-52d1-4a25-8fdd-222551e1e08b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf78e9a5-1f5b-4d4f-aafa-4c363a9ee00d]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flushing IO for device /dev/sdd {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c652ad1-bcdd-440b-b003-cfbf4891c51a]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9caaaf-2963-4cda-a267-d99cb440e294]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fd18cd-dcc3-4477-a314-c15ee6bc2280]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:33:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:36 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa775f10-21b4-430a-9e97-1eaec71399ed]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:36 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260]
Apr 11 19:33:36 user nova-compute[82196]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f, portal: 172.16.0.220,3260] successful.
Apr 11 19:33:36 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:33:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:36 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:443c1e0d-cc51-400f-8525-c5352514ce7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:36 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e62d43-1a5b-4414-96a6-175a2bd74896]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:36 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:33:36 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:33:36 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== disconnect_volume: return (295ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:33:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:33:36 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'flavor' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:33:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1d6fddee-6994-44db-ba8a-1d2fb4153d1a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.670s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:37 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:33:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:39 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:33:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:33:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:33:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:33:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:33:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:33:41 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:33:41 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating instance_info_cache with network_info: [{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:33:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:33:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:33:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:33:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:33:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:44 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:33:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:33:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:33:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:48 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:33:48 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7828MB free_disk=26.291088104248047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6802f099-9236-4c79-a892-2963f1b15b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance e6e3640a-c262-4e2d-a994-2e4312f22871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:33:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:49 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:33:49 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:33:49 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:33:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Received event network-changed-183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:33:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Refreshing instance network info cache due to event network-changed-183a0478-c117-4fe1-acce-22e4aee440c9. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:33:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] Acquiring lock "refresh_cache-e6e3640a-c262-4e2d-a994-2e4312f22871" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:33:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] Acquired lock "refresh_cache-e6e3640a-c262-4e2d-a994-2e4312f22871" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:33:53 user nova-compute[82196]: DEBUG nova.network.neutron [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Refreshing network info cache for port 183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:33:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Updated VIF entry in instance network info cache for port 183a0478-c117-4fe1-acce-22e4aee440c9. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:33:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Updating instance_info_cache with network_info: [{"id": "183a0478-c117-4fe1-acce-22e4aee440c9", "address": "fa:16:3e:6c:3e:6d", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183a0478-c1", "ovs_interfaceid": "183a0478-c117-4fe1-acce-22e4aee440c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:33:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6c99d4e4-1a6d-4747-afda-a8cec2df2255 req-75f5cab2-3c00-40fe-91cf-fdda4caf6c85 service nova] Releasing lock "refresh_cache-e6e3640a-c262-4e2d-a994-2e4312f22871" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:33:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "e6e3640a-c262-4e2d-a994-2e4312f22871" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'flavor' on Instance uuid e6e3640a-c262-4e2d-a994-2e4312f22871 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "e6e3640a-c262-4e2d-a994-2e4312f22871" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:55 user nova-compute[82196]: INFO nova.compute.manager [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Attaching volume 97161bc5-290b-4bf0-935f-4ab9ffc18101 to /dev/vdb
Apr 11 19:33:55 user nova-compute[82196]: DEBUG os_brick.utils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cfda3d-b020-4fda-8d00-0e852fcc608f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bceb7e-bf2f-4162-ad52-91577751bbfd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[532a799c-7c61-44e5-8017-03009bf7d4d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8fad5b-ad6b-4cf5-9703-0fc56e43175c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:33:55 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:33:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[005e412e-cb71-425c-bf3f-9cad3dbdfc11]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG os_brick.utils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:33:55 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Updating existing volume attachment record: 7593cd23-d6ac-4cf6-bcef-e91ed33eea50 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:33:56 user nova-compute[82196]: INFO nova.compute.claims [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Claim successful on node user
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'flavor' on Instance uuid 03bb985c-4903-4d0e-98a1-43a9352f4ec6 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:33:56 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Ignoring supplied device name: /dev/vdb
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:56 user nova-compute[82196]: INFO nova.compute.manager [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Attaching volume 9f851629-8083-428d-908d-5ab3e8e782f7 to /dev/vdb
Apr 11 19:33:56 user nova-compute[82196]: DEBUG os_brick.utils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ddcca3-de43-428c-a777-22459ec35d00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7501fc-561e-45f7-a0d4-f4397f4d56e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cd045b-13e2-412f-8de7-f07098f9256b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c5666f-737c-41ce-a184-669b23c810a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:33:56 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[142fb3f8-90d7-4cf1-a397-a4806ec7b377]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG os_brick.utils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Updating existing volume attachment record: 60788d00-8462-4bba-9059-62c13719a627 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:33:56 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.policy [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0558ba5a2b04d36ba2f2411090cc4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8b189667e34931aa36149620a036e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:33:56 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Creating image(s)
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "/opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "/opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk 1073741824" returned: 0 in 0.050s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Cannot resize image /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG nova.objects.instance [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'migration_context' on Instance uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Ensure instance console log exists: /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:33:57 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Successfully created port: 0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Successfully updated port: 0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquired lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-changed-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Refreshing instance network info cache due to event network-changed-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] Acquiring lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updating instance_info_cache with network_info: [{"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Releasing lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Instance network_info: |[{"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] Acquired lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.network.neutron [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Refreshing network info cache for port 0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Start _get_guest_xml network_info=[{"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:33:58 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:33:58 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:33:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1228547187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1228547187',id=30,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkkJTr5YuxkpX+fjT2biW1YPqt/B9xeGSfz5eI9idL14cBKKQVv2aWXZgrf6S4OtstSLTh3Ew1HBAxse2BI4QjcaST8i9go9QpbAcGCdV8ckJbY2dhHYp7Im1s1H/H33w==',key_name='tempest-keypair-1296340783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d8b189667e34931aa36149620a036e1',ramdisk_id='',reservation_id='r-jqpowijw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-427928846',owner_user_name='tempest-AttachVolumeShelveTestJSON-427928846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0558ba5a2b04d36ba2f2411090cc4e4',uuid=fbfa0825-c7c2-4f04-8c9a-102e238c3816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converting VIF {"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.objects.instance [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'pci_devices' on Instance uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:33:58 user nova-compute[82196]:   <uuid>fbfa0825-c7c2-4f04-8c9a-102e238c3816</uuid>
Apr 11 19:33:58 user nova-compute[82196]:   <name>instance-0000001e</name>
Apr 11 19:33:58 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:33:58 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:33:58 user nova-compute[82196]:   <metadata>
Apr 11 19:33:58 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:33:58 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:33:58 user nova-compute[82196]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1228547187</nova:name>
Apr 11 19:33:58 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:33:58</nova:creationTime>
Apr 11 19:33:58 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:33:58 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:33:58 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:33:58 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:33:58 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:33:58 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:33:58 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:33:58 user nova-compute[82196]:       <nova:owner>
Apr 11 19:33:58 user nova-compute[82196]:         <nova:user uuid="e0558ba5a2b04d36ba2f2411090cc4e4">tempest-AttachVolumeShelveTestJSON-427928846-project-member</nova:user>
Apr 11 19:33:58 user nova-compute[82196]:         <nova:project uuid="8d8b189667e34931aa36149620a036e1">tempest-AttachVolumeShelveTestJSON-427928846</nova:project>
Apr 11 19:33:58 user nova-compute[82196]:       </nova:owner>
Apr 11 19:33:58 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:33:58 user nova-compute[82196]:       <nova:ports>
Apr 11 19:33:58 user nova-compute[82196]:         <nova:port uuid="0be0dfa4-d8ad-4d32-83ab-a090c0f77f34">
Apr 11 19:33:58 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 19:33:58 user nova-compute[82196]:         </nova:port>
Apr 11 19:33:58 user nova-compute[82196]:       </nova:ports>
Apr 11 19:33:58 user nova-compute[82196]:     </nova:instance>
Apr 11 19:33:58 user nova-compute[82196]:   </metadata>
Apr 11 19:33:58 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:33:58 user nova-compute[82196]:     <system>
Apr 11 19:33:58 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:33:58 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:33:58 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:33:58 user nova-compute[82196]:       <entry name="serial">fbfa0825-c7c2-4f04-8c9a-102e238c3816</entry>
Apr 11 19:33:58 user nova-compute[82196]:       <entry name="uuid">fbfa0825-c7c2-4f04-8c9a-102e238c3816</entry>
Apr 11 19:33:58 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:33:58 user nova-compute[82196]:     </system>
Apr 11 19:33:58 user nova-compute[82196]:   </sysinfo>
Apr 11 19:33:58 user nova-compute[82196]:   <os>
Apr 11 19:33:58 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:33:58 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:33:58 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:33:58 user nova-compute[82196]:   </os>
Apr 11 19:33:58 user nova-compute[82196]:   <features>
Apr 11 19:33:58 user nova-compute[82196]:     <acpi/>
Apr 11 19:33:58 user nova-compute[82196]:     <apic/>
Apr 11 19:33:58 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:33:58 user nova-compute[82196]:   </features>
Apr 11 19:33:58 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:33:58 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:33:58 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:33:58 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:33:58 user nova-compute[82196]:   </clock>
Apr 11 19:33:58 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:33:58 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:33:58 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:33:58 user nova-compute[82196]:   </cpu>
Apr 11 19:33:58 user nova-compute[82196]:   <devices>
Apr 11 19:33:58 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:33:58 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:33:58 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk"/>
Apr 11 19:33:58 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:33:58 user nova-compute[82196]:     </disk>
Apr 11 19:33:58 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:33:58 user nova-compute[82196]:       <mac address="fa:16:3e:7b:46:50"/>
Apr 11 19:33:58 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:33:58 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:33:58 user nova-compute[82196]:       <target dev="tap0be0dfa4-d8"/>
Apr 11 19:33:58 user nova-compute[82196]:     </interface>
Apr 11 19:33:58 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:33:58 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/console.log" append="off"/>
Apr 11 19:33:58 user nova-compute[82196]:     </serial>
Apr 11 19:33:58 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:33:58 user nova-compute[82196]:     <video>
Apr 11 19:33:58 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:33:58 user nova-compute[82196]:     </video>
Apr 11 19:33:58 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:33:58 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:33:58 user nova-compute[82196]:     </rng>
Apr 11 19:33:58 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:33:58 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:33:58 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:33:58 user nova-compute[82196]:     </memballoon>
Apr 11 19:33:58 user nova-compute[82196]:   </devices>
Apr 11 19:33:58 user nova-compute[82196]: </domain>
Apr 11 19:33:58 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:33:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1228547187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1228547187',id=30,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkkJTr5YuxkpX+fjT2biW1YPqt/B9xeGSfz5eI9idL14cBKKQVv2aWXZgrf6S4OtstSLTh3Ew1HBAxse2BI4QjcaST8i9go9QpbAcGCdV8ckJbY2dhHYp7Im1s1H/H33w==',key_name='tempest-keypair-1296340783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d8b189667e34931aa36149620a036e1',ramdisk_id='',reservation_id='r-jqpowijw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-427928846',owner_user_name='tempest-AttachVolumeShelveTestJSON-427928846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0558ba5a2b04d36ba2f2411090cc4e4',uuid=fbfa0825-c7c2-4f04-8c9a-102e238c3816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converting VIF {"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG os_vif [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0be0dfa4-d8, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0be0dfa4-d8, col_values=(('external_ids', {'iface-id': '0be0dfa4-d8ad-4d32-83ab-a090c0f77f34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:46:50', 'vm-uuid': 'fbfa0825-c7c2-4f04-8c9a-102e238c3816'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:58 user nova-compute[82196]: INFO os_vif [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8')
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:33:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] No VIF found with MAC fa:16:3e:7b:46:50, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG nova.network.neutron [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updated VIF entry in instance network info cache for port 0be0dfa4-d8ad-4d32-83ab-a090c0f77f34. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG nova.network.neutron [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updating instance_info_cache with network_info: [{"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-96ffad30-3610-407e-a42f-a1adfcaccd1e req-19bee2c8-ab42-4752-a913-b1efb4dcfbf4 service nova] Releasing lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MjDCQynd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:33:59 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:33:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:33:59 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:33:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:33:59 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c004c527-6020-4ad8-9707-2073e5c9e753]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:33:59 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2623357b-0176-454c-870f-d84df80d405f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101] added
Apr 11 19:33:59 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52059a4-906d-402f-b9f0-461fa5aec518]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df48c9b-c0bf-4251-ad78-0b86846ce626]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MjDCQynd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MjDCQynd" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea4fc55-9352-4577-a965-615a9e4d6eab]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MjDCQynd'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:33:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dd251f-4133-4378-9bb9-0db3614dfe06]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ecd372-91ab-422c-87b5-db40bd27f51c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:00 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:34:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:00 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:34:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea75769-5051-46dc-93c0-f6eb86541a12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101, portal: 172.16.0.220,3260]
Apr 11 19:34:00 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101, portal: 172.16.0.220,3260] successful.
Apr 11 19:34:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c06b3b6-fbbb-4542-8d90-7ff9bf01e8ab]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4f6f9e-4289-4064-8f76-532adfbd252d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:00 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:34:00 user nova-compute[82196]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)
Apr 11 19:34:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:00 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:34:00 user nova-compute[82196]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)
Apr 11 19:34:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71ee8bd-c13d-408c-baa5-54cc6e1c6eff]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MjDCQynd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:00 user nova-compute[82196]: INFO nova.compute.manager [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Terminating instance
Apr 11 19:34:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-3d9c7e8e-26cc-4969-a0c3-8b6e5786550a req-9bbfa250-5995-44c5-9d85-08c8256b2cb3 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3d9c7e8e-26cc-4969-a0c3-8b6e5786550a req-9bbfa250-5995-44c5-9d85-08c8256b2cb3 service nova] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3d9c7e8e-26cc-4969-a0c3-8b6e5786550a req-9bbfa250-5995-44c5-9d85-08c8256b2cb3 service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3d9c7e8e-26cc-4969-a0c3-8b6e5786550a req-9bbfa250-5995-44c5-9d85-08c8256b2cb3 service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-3d9c7e8e-26cc-4969-a0c3-8b6e5786550a req-9bbfa250-5995-44c5-9d85-08c8256b2cb3 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] No waiting events found dispatching network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:00 user nova-compute[82196]: WARNING nova.compute.manager [req-3d9c7e8e-26cc-4969-a0c3-8b6e5786550a req-9bbfa250-5995-44c5-9d85-08c8256b2cb3 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received unexpected event network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance with vm_state building and task_state spawning.
Apr 11 19:34:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-895b16cc-db18-4011-963a-f2d7c84da3fa req-dee1c8d7-ba79-43f9-bed6-3deac5ad17a7 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Received event network-vif-unplugged-07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-895b16cc-db18-4011-963a-f2d7c84da3fa req-dee1c8d7-ba79-43f9-bed6-3deac5ad17a7 service nova] Acquiring lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-895b16cc-db18-4011-963a-f2d7c84da3fa req-dee1c8d7-ba79-43f9-bed6-3deac5ad17a7 service nova] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-895b16cc-db18-4011-963a-f2d7c84da3fa req-dee1c8d7-ba79-43f9-bed6-3deac5ad17a7 service nova] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-895b16cc-db18-4011-963a-f2d7c84da3fa req-dee1c8d7-ba79-43f9-bed6-3deac5ad17a7 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] No waiting events found dispatching network-vif-unplugged-07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-895b16cc-db18-4011-963a-f2d7c84da3fa req-dee1c8d7-ba79-43f9-bed6-3deac5ad17a7 service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Received event network-vif-unplugged-07039db4-244e-4941-ae2b-5f396531e40d for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "b079367a-558e-4920-ad8d-972a8065260c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "b079367a-558e-4920-ad8d-972a8065260c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujlnZVSF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:34:01 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:34:01 user nova-compute[82196]: INFO nova.compute.claims [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Claim successful on node user
Apr 11 19:34:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26262383332633065', 'path': '/dev/sdd'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262383332633065', 'path': '/dev/sdd'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.122s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:34:01 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:34:01 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c7099d-6093-4d72-8ef6-199958b240ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'flavor' on Instance uuid e6e3640a-c262-4e2d-a994-2e4312f22871 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:34:01 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:01 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Instance destroyed successfully.
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lazy-loading 'resources' on Instance uuid cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7109a8-acc7-4017-afde-8cc517193c1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7] added
Apr 11 19:34:01 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:34:01 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:34:01 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:34:01 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:34:01 user nova-compute[82196]:   <serial>97161bc5-290b-4bf0-935f-4ab9ffc18101</serial>
Apr 11 19:34:01 user nova-compute[82196]: </disk>
Apr 11 19:34:01 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1884458262',display_name='tempest-TestVolumeBootPattern-server-1884458262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1884458262',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:32:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-b1o37gxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:32:26Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07039db4-244e-4941-ae2b-5f396531e40d", "address": "fa:16:3e:a2:73:6f", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07039db4-24", "ovs_interfaceid": "07039db4-244e-4941-ae2b-5f396531e40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "07039db4-244e-4941-ae2b-5f396531e40d", "address": "fa:16:3e:a2:73:6f", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07039db4-24", "ovs_interfaceid": "07039db4-244e-4941-ae2b-5f396531e40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=07039db4-244e-4941-ae2b-5f396531e40d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07039db4-24') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_vif [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=07039db4-244e-4941-ae2b-5f396531e40d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07039db4-24') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07039db4-24, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1895428-1eb7-43b8-aaa1-a5efd85d2f71]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:01 user nova-compute[82196]: INFO os_vif [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=07039db4-244e-4941-ae2b-5f396531e40d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07039db4-24')
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYUbieSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:34:01 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41505d9-b491-454a-ab24-b143486b7a37]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujlnZVSF {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujlnZVSF" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c72871-c68d-4cce-a63a-18bf4f7956af]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ujlnZVSF'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2f6e14-8d9e-434c-9473-9d1f60ae4c89]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e54663c-88b1-457e-b602-3aaa31388d6b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba9eef6-c359-4468-9757-2ae3c01b8151]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7, portal: 172.16.0.220,3260]
Apr 11 19:34:01 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7, portal: 172.16.0.220,3260] successful.
Apr 11 19:34:01 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd8546c-2e34-4c6b-b918-ef1c124857dc]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c79b73-a6a0-49aa-b5ad-546c3dcba6fe]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 (non-flash)
Apr 11 19:34:01 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7c9ecc-1752-49de-b76b-a05e913889d6]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujlnZVSF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] No VIF found with MAC fa:16:3e:6c:3e:6d, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.network.neutron [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:34:01 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.policy [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8a3c5049-f2c5-4673-94bf-75e147c9333c tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.371s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:34:01 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Creating image(s)
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "/opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "/opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "/opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.155s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk 1073741824" returned: 0 in 0.058s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "e6e3640a-c262-4e2d-a994-2e4312f22871" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:02 user nova-compute[82196]: INFO nova.compute.manager [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Detaching volume 97161bc5-290b-4bf0-935f-4ab9ffc18101
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.154s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.network.neutron [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Successfully created port: 54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:34:02 user nova-compute[82196]: INFO nova.virt.block_device [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Attempting to driver detach volume 97161bc5-290b-4bf0-935f-4ab9ffc18101 from mountpoint /dev/vdb
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241642.5177245, fbfa0825-c7c2-4f04-8c9a-102e238c3816 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:34:02 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] VM Resumed (Lifecycle Event)
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:34:02 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Instance spawned successfully.
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Attempting to detach device vdb from instance e6e3640a-c262-4e2d-a994-2e4312f22871 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:34:02 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:34:02 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:34:02 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:34:02 user nova-compute[82196]:   <serial>97161bc5-290b-4bf0-935f-4ab9ffc18101</serial>
Apr 11 19:34:02 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:34:02 user nova-compute[82196]: </disk>
Apr 11 19:34:02 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:34:02 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully detached device vdb from instance e6e3640a-c262-4e2d-a994-2e4312f22871 from the persistent domain config.
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6e3640a-c262-4e2d-a994-2e4312f22871 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:34:02 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:34:02 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:34:02 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:34:02 user nova-compute[82196]:   <serial>97161bc5-290b-4bf0-935f-4ab9ffc18101</serial>
Apr 11 19:34:02 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:34:02 user nova-compute[82196]: </disk>
Apr 11 19:34:02 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:34:02 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241642.519542, fbfa0825-c7c2-4f04-8c9a-102e238c3816 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:34:02 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] VM Started (Lifecycle Event)
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] <== connect_volume: return (1512ms) {'type': 'block', 'scsi_wwn': '23764616534303463', 'path': '/dev/sde'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764616534303463', 'path': '/dev/sde'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.264s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'flavor' on Instance uuid 03bb985c-4903-4d0e-98a1-43a9352f4ec6 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Cannot resize image /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.objects.instance [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'migration_context' on Instance uuid b079367a-558e-4920-ad8d-972a8065260c {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cee542-0285-4e3c-ad8b-2f77ff1a2d78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:34:02 user nova-compute[82196]: No targets found.
Apr 11 19:34:02 user nova-compute[82196]: iSNS:
Apr 11 19:34:02 user nova-compute[82196]: No targets found.
Apr 11 19:34:02 user nova-compute[82196]: STATIC:
Apr 11 19:34:02 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:34:02 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:34:02 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:34:02 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101
Apr 11 19:34:02 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:34:02 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:34:02 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92
Apr 11 19:34:02 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:34:02 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:34:02 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7
Apr 11 19:34:02 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:34:02 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:34:02 user nova-compute[82196]: FIRMWARE:
Apr 11 19:34:02 user nova-compute[82196]: No targets found.
Apr 11 19:34:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:34:02 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:34:02 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:34:02 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:34:02 user nova-compute[82196]:   <source dev="/dev/sde"/>
Apr 11 19:34:02 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:34:02 user nova-compute[82196]:   <serial>9f851629-8083-428d-908d-5ab3e8e782f7</serial>
Apr 11 19:34:02 user nova-compute[82196]: </disk>
Apr 11 19:34:02 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:34:02 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:34:02 user nova-compute[82196]: INFO nova.compute.manager [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Took 5.81 seconds to spawn the instance on the hypervisor.
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8627e54-dc27-4abc-9085-3db0afe3fc30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Ensure instance console log exists: /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2390a7c6-8a4f-4ea6-8050-d7b4c878b86f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:02 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:34:02 user nova-compute[82196]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)
Apr 11 19:34:02 user nova-compute[82196]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 (non-flash)
Apr 11 19:34:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:02 user nova-compute[82196]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 (non-flash)
Apr 11 19:34:02 user nova-compute[82196]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)
Apr 11 19:34:02 user nova-compute[82196]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 (non-flash)
Apr 11 19:34:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9264120700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92'): ({'sdc'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Removing single pathed devices sdc {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-f3ed1f58-814e-47b4-926e-50e4b2f01a6c req-59b30f58-6b11-4d0f-997a-39a8512b3163 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f3ed1f58-814e-47b4-926e-50e4b2f01a6c req-59b30f58-6b11-4d0f-997a-39a8512b3163 service nova] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f3ed1f58-814e-47b4-926e-50e4b2f01a6c req-59b30f58-6b11-4d0f-997a-39a8512b3163 service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f3ed1f58-814e-47b4-926e-50e4b2f01a6c req-59b30f58-6b11-4d0f-997a-39a8512b3163 service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-f3ed1f58-814e-47b4-926e-50e4b2f01a6c req-59b30f58-6b11-4d0f-997a-39a8512b3163 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] No waiting events found dispatching network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:02 user nova-compute[82196]: WARNING nova.compute.manager [req-f3ed1f58-814e-47b4-926e-50e4b2f01a6c req-59b30f58-6b11-4d0f-997a-39a8512b3163 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received unexpected event network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance with vm_state building and task_state spawning.
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f634ef5-a183-4ac8-95f4-7da1cff32df2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: INFO nova.compute.manager [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Took 6.63 seconds to build instance.
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade93af7-2ec2-47c3-b42b-06fcf68a6253]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flushing IO for device /dev/sdc {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2691374e-7e5c-4dc8-9ca8-b62bf47c3dc1 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.751s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaeb844-d03b-4872-a65c-f7cb76fe236a]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[13860a94-264a-4f50-a9a6-ab72faa7cf26]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[97020537-4b7b-44ef-95ce-39baf5187514]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df020a-1e9f-40eb-810c-7e8f7daf9cfb]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92, portal: 172.16.0.220,3260]
Apr 11 19:34:02 user nova-compute[82196]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92, portal: 172.16.0.220,3260] successful.
Apr 11 19:34:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88788728-a3d3-4402-b948-5c1beec86f92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad6f31e-61b7-4198-b492-27b6606a1bdd]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== disconnect_volume: return (1634ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:34:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:34:02 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Deleting instance files /opt/stack/data/nova/instances/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08_del
Apr 11 19:34:02 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Deletion of /opt/stack/data/nova/instances/cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08_del complete
Apr 11 19:34:03 user nova-compute[82196]: INFO nova.compute.manager [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Took 2.57 seconds to destroy the instance on the hypervisor.
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] No VIF found with MAC fa:16:3e:e5:31:c4, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.compute.manager [req-83f1d004-d350-4287-a435-e71ff32fc34e req-922ecf3d-a84c-4344-895e-a2f61b455ccb service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Received event network-vif-plugged-07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-83f1d004-d350-4287-a435-e71ff32fc34e req-922ecf3d-a84c-4344-895e-a2f61b455ccb service nova] Acquiring lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-83f1d004-d350-4287-a435-e71ff32fc34e req-922ecf3d-a84c-4344-895e-a2f61b455ccb service nova] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-83f1d004-d350-4287-a435-e71ff32fc34e req-922ecf3d-a84c-4344-895e-a2f61b455ccb service nova] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.compute.manager [req-83f1d004-d350-4287-a435-e71ff32fc34e req-922ecf3d-a84c-4344-895e-a2f61b455ccb service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] No waiting events found dispatching network-vif-plugged-07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:03 user nova-compute[82196]: WARNING nova.compute.manager [req-83f1d004-d350-4287-a435-e71ff32fc34e req-922ecf3d-a84c-4344-895e-a2f61b455ccb service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Received unexpected event network-vif-plugged-07039db4-244e-4941-ae2b-5f396531e40d for instance with vm_state active and task_state deleting.
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a9a1cc7d-2bba-473b-b7e4-f28ecbec9fa9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.913s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.network.neutron [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Successfully updated port: 54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241643.3178434, e6e3640a-c262-4e2d-a994-2e4312f22871 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6e3640a-c262-4e2d-a994-2e4312f22871 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "refresh_cache-b079367a-558e-4920-ad8d-972a8065260c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquired lock "refresh_cache-b079367a-558e-4920-ad8d-972a8065260c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.network.neutron [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:34:03 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully detached device vdb from instance e6e3640a-c262-4e2d-a994-2e4312f22871 from the live domain config.
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MjDCQynd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:34:03 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd3049b-0c74-4eaf-9a34-5fb78d2dd2ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:34:03 user nova-compute[82196]: No targets found.
Apr 11 19:34:03 user nova-compute[82196]: iSNS:
Apr 11 19:34:03 user nova-compute[82196]: No targets found.
Apr 11 19:34:03 user nova-compute[82196]: STATIC:
Apr 11 19:34:03 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:34:03 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:34:03 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:34:03 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101
Apr 11 19:34:03 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:34:03 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:34:03 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7
Apr 11 19:34:03 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:34:03 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:34:03 user nova-compute[82196]: FIRMWARE:
Apr 11 19:34:03 user nova-compute[82196]: No targets found.
Apr 11 19:34:03 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:34:03 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:34:03 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.network.neutron [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1563ab23-207c-4c02-895b-b6acf53c699f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce5f2c8-c504-43e0-8892-ae9f9d39d218]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:03 user nova-compute[82196]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)
Apr 11 19:34:03 user nova-compute[82196]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 (non-flash)
Apr 11 19:34:03 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:03 user nova-compute[82196]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 (non-flash)
Apr 11 19:34:03 user nova-compute[82196]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 (non-flash)
Apr 11 19:34:03 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927c01a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101'): ({'sdd'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Removing single pathed devices sdd {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3acec8-b241-4eb4-8753-b118045dc76d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb0fb8f-57df-4277-8614-c1f32186633a]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Flushing IO for device /dev/sdd {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9feae0-2141-4dba-bf4e-da65328d2fc0]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2bc562-f6d9-4e92-8eda-ca408e407c0f]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ae7068-47fa-4430-946e-850e8a98d0be]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:34:03 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Took 0.54 seconds to deallocate network for instance.
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce98340c-7e12-4fac-a530-4f928130488b]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101, portal: 172.16.0.220,3260]
Apr 11 19:34:03 user nova-compute[82196]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101, portal: 172.16.0.220,3260] successful.
Apr 11 19:34:03 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97161bc5-290b-4bf0-935f-4ab9ffc18101 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[406933b8-5828-4a72-adbb-5c15eb64f1b5]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] <== disconnect_volume: return (323ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.network.neutron [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Updating instance_info_cache with network_info: [{"id": "54168103-37cf-4abe-a4e5-bac3eeeca578", "address": "fa:16:3e:29:d3:5a", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54168103-37", "ovs_interfaceid": "54168103-37cf-4abe-a4e5-bac3eeeca578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Releasing lock "refresh_cache-b079367a-558e-4920-ad8d-972a8065260c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Instance network_info: |[{"id": "54168103-37cf-4abe-a4e5-bac3eeeca578", "address": "fa:16:3e:29:d3:5a", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54168103-37", "ovs_interfaceid": "54168103-37cf-4abe-a4e5-bac3eeeca578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Start _get_guest_xml network_info=[{"id": "54168103-37cf-4abe-a4e5-bac3eeeca578", "address": "fa:16:3e:29:d3:5a", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54168103-37", "ovs_interfaceid": "54168103-37cf-4abe-a4e5-bac3eeeca578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:34:03 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:34:03 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1965367859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1965367859',id=31,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-csx0nx90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:34:02Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=b079367a-558e-4920-ad8d-972a8065260c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54168103-37cf-4abe-a4e5-bac3eeeca578", "address": "fa:16:3e:29:d3:5a", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54168103-37", "ovs_interfaceid": "54168103-37cf-4abe-a4e5-bac3eeeca578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "54168103-37cf-4abe-a4e5-bac3eeeca578", "address": "fa:16:3e:29:d3:5a", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54168103-37", "ovs_interfaceid": "54168103-37cf-4abe-a4e5-bac3eeeca578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:d3:5a,bridge_name='br-int',has_traffic_filtering=True,id=54168103-37cf-4abe-a4e5-bac3eeeca578,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54168103-37') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.objects.instance [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'pci_devices' on Instance uuid b079367a-558e-4920-ad8d-972a8065260c {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:34:03 user nova-compute[82196]:   <uuid>b079367a-558e-4920-ad8d-972a8065260c</uuid>
Apr 11 19:34:03 user nova-compute[82196]:   <name>instance-0000001f</name>
Apr 11 19:34:03 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:34:03 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:34:03 user nova-compute[82196]:   <metadata>
Apr 11 19:34:03 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:34:03 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:34:03 user nova-compute[82196]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1965367859</nova:name>
Apr 11 19:34:03 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:34:03</nova:creationTime>
Apr 11 19:34:03 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:34:03 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:34:03 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:34:03 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:34:03 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:34:03 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:34:03 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:34:03 user nova-compute[82196]:       <nova:owner>
Apr 11 19:34:03 user nova-compute[82196]:         <nova:user uuid="1b3adca432b04d70818a51d1366f5c6d">tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member</nova:user>
Apr 11 19:34:03 user nova-compute[82196]:         <nova:project uuid="eb91586feb3f4a4c84fa8c2183baaf8c">tempest-ServerBootFromVolumeStableRescueTest-863156619</nova:project>
Apr 11 19:34:03 user nova-compute[82196]:       </nova:owner>
Apr 11 19:34:03 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:34:03 user nova-compute[82196]:       <nova:ports>
Apr 11 19:34:03 user nova-compute[82196]:         <nova:port uuid="54168103-37cf-4abe-a4e5-bac3eeeca578">
Apr 11 19:34:03 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 19:34:03 user nova-compute[82196]:         </nova:port>
Apr 11 19:34:03 user nova-compute[82196]:       </nova:ports>
Apr 11 19:34:03 user nova-compute[82196]:     </nova:instance>
Apr 11 19:34:03 user nova-compute[82196]:   </metadata>
Apr 11 19:34:03 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:34:03 user nova-compute[82196]:     <system>
Apr 11 19:34:03 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:34:03 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:34:03 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:34:03 user nova-compute[82196]:       <entry name="serial">b079367a-558e-4920-ad8d-972a8065260c</entry>
Apr 11 19:34:03 user nova-compute[82196]:       <entry name="uuid">b079367a-558e-4920-ad8d-972a8065260c</entry>
Apr 11 19:34:03 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:34:03 user nova-compute[82196]:     </system>
Apr 11 19:34:03 user nova-compute[82196]:   </sysinfo>
Apr 11 19:34:03 user nova-compute[82196]:   <os>
Apr 11 19:34:03 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:34:03 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:34:03 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:34:03 user nova-compute[82196]:   </os>
Apr 11 19:34:03 user nova-compute[82196]:   <features>
Apr 11 19:34:03 user nova-compute[82196]:     <acpi/>
Apr 11 19:34:03 user nova-compute[82196]:     <apic/>
Apr 11 19:34:03 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:34:03 user nova-compute[82196]:   </features>
Apr 11 19:34:03 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:34:03 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:34:03 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:34:03 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:34:03 user nova-compute[82196]:   </clock>
Apr 11 19:34:03 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:34:03 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:34:03 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:34:03 user nova-compute[82196]:   </cpu>
Apr 11 19:34:03 user nova-compute[82196]:   <devices>
Apr 11 19:34:03 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:34:03 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:34:03 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk"/>
Apr 11 19:34:03 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:34:03 user nova-compute[82196]:     </disk>
Apr 11 19:34:03 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:34:03 user nova-compute[82196]:       <mac address="fa:16:3e:29:d3:5a"/>
Apr 11 19:34:03 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:34:03 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:34:03 user nova-compute[82196]:       <target dev="tap54168103-37"/>
Apr 11 19:34:03 user nova-compute[82196]:     </interface>
Apr 11 19:34:03 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:34:03 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/console.log" append="off"/>
Apr 11 19:34:03 user nova-compute[82196]:     </serial>
Apr 11 19:34:03 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:34:03 user nova-compute[82196]:     <video>
Apr 11 19:34:03 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:34:03 user nova-compute[82196]:     </video>
Apr 11 19:34:03 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:34:03 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:34:03 user nova-compute[82196]:     </rng>
Apr 11 19:34:03 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:34:03 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:34:03 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:34:03 user nova-compute[82196]:     </memballoon>
Apr 11 19:34:03 user nova-compute[82196]:   </devices>
Apr 11 19:34:03 user nova-compute[82196]: </domain>
Apr 11 19:34:03 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1965367859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1965367859',id=31,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-csx0nx90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:34:02Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=b079367a-558e-4920-ad8d-972a8065260c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54168103-37cf-4abe-a4e5-bac3eeeca578", "address": "fa:16:3e:29:d3:5a", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54168103-37", "ovs_interfaceid": "54168103-37cf-4abe-a4e5-bac3eeeca578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "54168103-37cf-4abe-a4e5-bac3eeeca578", "address": "fa:16:3e:29:d3:5a", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54168103-37", "ovs_interfaceid": "54168103-37cf-4abe-a4e5-bac3eeeca578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:d3:5a,bridge_name='br-int',has_traffic_filtering=True,id=54168103-37cf-4abe-a4e5-bac3eeeca578,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54168103-37') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG os_vif [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:d3:5a,bridge_name='br-int',has_traffic_filtering=True,id=54168103-37cf-4abe-a4e5-bac3eeeca578,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54168103-37') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54168103-37, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54168103-37, col_values=(('external_ids', {'iface-id': '54168103-37cf-4abe-a4e5-bac3eeeca578', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:d3:5a', 'vm-uuid': 'b079367a-558e-4920-ad8d-972a8065260c'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:03 user nova-compute[82196]: INFO os_vif [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:d3:5a,bridge_name='br-int',has_traffic_filtering=True,id=54168103-37cf-4abe-a4e5-bac3eeeca578,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54168103-37')
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:34:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No VIF found with MAC fa:16:3e:29:d3:5a, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:34:04 user nova-compute[82196]: INFO nova.compute.manager [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Took 0.87 seconds to detach 1 volumes for instance.
Apr 11 19:34:04 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Deleting volume: 88788728-a3d3-4402-b948-5c1beec86f92 {{(pid=82196) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 19:34:04 user nova-compute[82196]: DEBUG nova.objects.instance [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'flavor' on Instance uuid e6e3640a-c262-4e2d-a994-2e4312f22871 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-222fdbcf-2a59-4779-b822-e5be35336bf4 tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.250s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-42abf785-9b62-4838-b1ed-f12a18023c8e req-13afcedb-aa22-4b2c-b562-eb23749040ba service nova] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Received event network-vif-deleted-07039db4-244e-4941-ae2b-5f396531e40d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:05 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Deleted allocations for instance cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08
Apr 11 19:34:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1f74d1dc-585d-4bab-84f7-3bb21fa98bc1 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.736s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received event network-changed-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Refreshing instance network info cache due to event network-changed-54168103-37cf-4abe-a4e5-bac3eeeca578. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] Acquiring lock "refresh_cache-b079367a-558e-4920-ad8d-972a8065260c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] Acquired lock "refresh_cache-b079367a-558e-4920-ad8d-972a8065260c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG nova.network.neutron [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Refreshing network info cache for port 54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG nova.network.neutron [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Updated VIF entry in instance network info cache for port 54168103-37cf-4abe-a4e5-bac3eeeca578. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:34:05 user nova-compute[82196]: DEBUG nova.network.neutron [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Updating instance_info_cache with network_info: [{"id": "54168103-37cf-4abe-a4e5-bac3eeeca578", "address": "fa:16:3e:29:d3:5a", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54168103-37", "ovs_interfaceid": "54168103-37cf-4abe-a4e5-bac3eeeca578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:34:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-62e18b75-7758-43b6-a601-edb397df52c8 req-5e8eeff5-a2af-46e0-b334-7b6d6045a2cb service nova] Releasing lock "refresh_cache-b079367a-558e-4920-ad8d-972a8065260c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:34:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received event network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] Acquiring lock "b079367a-558e-4920-ad8d-972a8065260c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] No waiting events found dispatching network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:06 user nova-compute[82196]: WARNING nova.compute.manager [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received unexpected event network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 for instance with vm_state building and task_state spawning.
Apr 11 19:34:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received event network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] Acquiring lock "b079367a-558e-4920-ad8d-972a8065260c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] No waiting events found dispatching network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:06 user nova-compute[82196]: WARNING nova.compute.manager [req-646910c8-b013-4db5-9230-76153d16b9d6 req-1f24bb63-4889-4632-94cf-344cfdb68b9a service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received unexpected event network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 for instance with vm_state building and task_state spawning.
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241647.647574, b079367a-558e-4920-ad8d-972a8065260c => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:34:07 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b079367a-558e-4920-ad8d-972a8065260c] VM Resumed (Lifecycle Event)
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:34:07 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: b079367a-558e-4920-ad8d-972a8065260c] Instance spawned successfully.
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b079367a-558e-4920-ad8d-972a8065260c] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b079367a-558e-4920-ad8d-972a8065260c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:34:07 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b079367a-558e-4920-ad8d-972a8065260c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241647.6486228, b079367a-558e-4920-ad8d-972a8065260c => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:34:07 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b079367a-558e-4920-ad8d-972a8065260c] VM Started (Lifecycle Event)
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b079367a-558e-4920-ad8d-972a8065260c] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:34:07 user nova-compute[82196]: INFO nova.compute.manager [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Took 5.85 seconds to spawn the instance on the hypervisor.
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:34:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b079367a-558e-4920-ad8d-972a8065260c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:34:07 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: b079367a-558e-4920-ad8d-972a8065260c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:34:07 user nova-compute[82196]: INFO nova.compute.manager [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Took 6.81 seconds to build instance.
Apr 11 19:34:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4913921-1ae8-474e-8a41-ee9b4327c33b tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "b079367a-558e-4920-ad8d-972a8065260c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.930s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:11 user nova-compute[82196]: INFO nova.compute.manager [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Detaching volume 9f851629-8083-428d-908d-5ab3e8e782f7
Apr 11 19:34:11 user nova-compute[82196]: INFO nova.virt.block_device [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Attempting to driver detach volume 9f851629-8083-428d-908d-5ab3e8e782f7 from mountpoint /dev/vdb
Apr 11 19:34:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Attempting to detach device vdb from instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:34:11 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:34:11 user nova-compute[82196]:   <source dev="/dev/sde"/>
Apr 11 19:34:11 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:34:11 user nova-compute[82196]:   <serial>9f851629-8083-428d-908d-5ab3e8e782f7</serial>
Apr 11 19:34:11 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:34:11 user nova-compute[82196]: </disk>
Apr 11 19:34:11 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:11 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Successfully detached device vdb from instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 from the persistent domain config.
Apr 11 19:34:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:34:11 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:34:11 user nova-compute[82196]:   <source dev="/dev/sde"/>
Apr 11 19:34:11 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:34:11 user nova-compute[82196]:   <serial>9f851629-8083-428d-908d-5ab3e8e782f7</serial>
Apr 11 19:34:11 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:34:11 user nova-compute[82196]: </disk>
Apr 11 19:34:11 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241651.8654501, 03bb985c-4903-4d0e-98a1-43a9352f4ec6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:34:11 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Successfully detached device vdb from instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6 from the live domain config.
Apr 11 19:34:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujlnZVSF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:34:11 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:34:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b19171-0d9d-4be3-b6df-27d8634212db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:34:11 user nova-compute[82196]: No targets found.
Apr 11 19:34:11 user nova-compute[82196]: iSNS:
Apr 11 19:34:11 user nova-compute[82196]: No targets found.
Apr 11 19:34:11 user nova-compute[82196]: STATIC:
Apr 11 19:34:11 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:34:11 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:34:11 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:34:11 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7
Apr 11 19:34:11 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:34:11 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:34:11 user nova-compute[82196]: FIRMWARE:
Apr 11 19:34:11 user nova-compute[82196]: No targets found.
Apr 11 19:34:11 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:34:11 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:34:11 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a11aa04-8114-4c16-962d-1f7bb3956087]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f2a839-8c43-430e-860e-c36def349440]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:11 user nova-compute[82196]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 (non-flash)
Apr 11 19:34:11 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:11 user nova-compute[82196]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 (non-flash)
Apr 11 19:34:11 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9281a88790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7'): ({'sde'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Removing single pathed devices sde {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e20dac-f025-4374-8b05-8d31d9f5724a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1145681d-43b6-44c9-a88c-7d36fa97afd4]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Flushing IO for device /dev/sde {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc79ab5b-3676-4a88-824e-6edd54a63998]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f0591e-0dfb-4874-9b6a-fb7bbfd60c71]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] SCSI volumes sde have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2260cf-2e1d-40b5-b2f2-78f015b3844f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4033af2-e9b4-4618-b906-9a22ac2b5f39]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7, portal: 172.16.0.220,3260]
Apr 11 19:34:12 user nova-compute[82196]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7, portal: 172.16.0.220,3260] successful.
Apr 11 19:34:12 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e10ca34-7277-4582-b9dc-ddbda6d30a37]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] <== disconnect_volume: return (323ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:34:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'flavor' on Instance uuid 03bb985c-4903-4d0e-98a1-43a9352f4ec6 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ee8e63c2-b0fc-407a-ae31-0e2c5e338498 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.920s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.803s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:13 user nova-compute[82196]: INFO nova.compute.manager [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Terminating instance
Apr 11 19:34:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-83a94fa3-17fe-4d50-84ce-46d40c32c902 req-4b18e4f8-fc2b-471b-af1b-ad2ec798759b service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Received event network-vif-unplugged-2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-83a94fa3-17fe-4d50-84ce-46d40c32c902 req-4b18e4f8-fc2b-471b-af1b-ad2ec798759b service nova] Acquiring lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-83a94fa3-17fe-4d50-84ce-46d40c32c902 req-4b18e4f8-fc2b-471b-af1b-ad2ec798759b service nova] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-83a94fa3-17fe-4d50-84ce-46d40c32c902 req-4b18e4f8-fc2b-471b-af1b-ad2ec798759b service nova] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-83a94fa3-17fe-4d50-84ce-46d40c32c902 req-4b18e4f8-fc2b-471b-af1b-ad2ec798759b service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] No waiting events found dispatching network-vif-unplugged-2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-83a94fa3-17fe-4d50-84ce-46d40c32c902 req-4b18e4f8-fc2b-471b-af1b-ad2ec798759b service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Received event network-vif-unplugged-2da07e24-d185-4553-ab56-819067f03d48 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:34:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:14 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Instance destroyed successfully.
Apr 11 19:34:14 user nova-compute[82196]: DEBUG nova.objects.instance [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'resources' on Instance uuid 03bb985c-4903-4d0e-98a1-43a9352f4ec6 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1542491412',display_name='tempest-VolumesSnapshotTestJSON-instance-1542491412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1542491412',id=28,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d5246cf04a7401388cba38d16e298ae',ramdisk_id='',reservation_id='r-o45jrj9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-111705993',owner_user_name='tempest-VolumesSnapshotTestJSON-111705993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:32:15Z,user_data=None,user_id='20f337feb0ed4653976ace530bfdd877',uuid=03bb985c-4903-4d0e-98a1-43a9352f4ec6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2da07e24-d185-4553-ab56-819067f03d48", "address": "fa:16:3e:e5:31:c4", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da07e24-d1", "ovs_interfaceid": "2da07e24-d185-4553-ab56-819067f03d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Converting VIF {"id": "2da07e24-d185-4553-ab56-819067f03d48", "address": "fa:16:3e:e5:31:c4", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da07e24-d1", "ovs_interfaceid": "2da07e24-d185-4553-ab56-819067f03d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=2da07e24-d185-4553-ab56-819067f03d48,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da07e24-d1') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_vif [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=2da07e24-d185-4553-ab56-819067f03d48,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da07e24-d1') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2da07e24-d1, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:14 user nova-compute[82196]: INFO os_vif [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=2da07e24-d185-4553-ab56-819067f03d48,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da07e24-d1')
Apr 11 19:34:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujlnZVSF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:34:14 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cb954a-5b7d-48ed-b57a-eaed8765f36c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:34:14 user nova-compute[82196]: No targets found.
Apr 11 19:34:14 user nova-compute[82196]: iSNS:
Apr 11 19:34:14 user nova-compute[82196]: No targets found.
Apr 11 19:34:14 user nova-compute[82196]: STATIC:
Apr 11 19:34:14 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:34:14 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:34:14 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:34:14 user nova-compute[82196]: FIRMWARE:
Apr 11 19:34:14 user nova-compute[82196]: No targets found.
Apr 11 19:34:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:34:14 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:34:14 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f851629-8083-428d-908d-5ab3e8e782f7', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51f5037-fa4b-4865-b1c5-b76918543fcf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67fa88-0b87-4ce7-8309-31207fa83246]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:34:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927c1d1480>, {}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Disconnecting from: [] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] <== disconnect_volume: return (76ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:34:14 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Deleting instance files /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6_del
Apr 11 19:34:14 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Deletion of /opt/stack/data/nova/instances/03bb985c-4903-4d0e-98a1-43a9352f4ec6_del complete
Apr 11 19:34:14 user nova-compute[82196]: INFO nova.compute.manager [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:34:14 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Took 0.53 seconds to deallocate network for instance.
Apr 11 19:34:14 user nova-compute[82196]: WARNING nova.volume.cinder [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Attachment 60788d00-8462-4bba-9059-62c13719a627 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 60788d00-8462-4bba-9059-62c13719a627. (HTTP 404) (Request-ID: req-f78e248e-1ddf-47a0-acb1-ef32690d5981)
Apr 11 19:34:14 user nova-compute[82196]: INFO nova.compute.manager [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Took 0.03 seconds to detach 1 volumes for instance.
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:14 user nova-compute[82196]: INFO nova.compute.manager [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Terminating instance
Apr 11 19:34:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:15 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Deleted allocations for instance 03bb985c-4903-4d0e-98a1-43a9352f4ec6
Apr 11 19:34:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-03d27963-1f01-4a13-9372-9af9ec36c9c9 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Received event network-vif-plugged-2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Acquiring lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Lock "03bb985c-4903-4d0e-98a1-43a9352f4ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] No waiting events found dispatching network-vif-plugged-2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:15 user nova-compute[82196]: WARNING nova.compute.manager [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Received unexpected event network-vif-plugged-2da07e24-d185-4553-ab56-819067f03d48 for instance with vm_state deleted and task_state None.
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Received event network-vif-deleted-2da07e24-d185-4553-ab56-819067f03d48 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-unplugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] No waiting events found dispatching network-vif-unplugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-unplugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Acquiring lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] Lock "6802f099-9236-4c79-a892-2963f1b15b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] No waiting events found dispatching network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:15 user nova-compute[82196]: WARNING nova.compute.manager [req-f18861af-a0bf-455a-9ec4-f7b5514a006e req-c1bb124f-4c3a-41e2-84b5-85fd428c8c00 service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received unexpected event network-vif-plugged-6193819b-0c1b-476b-b89e-dbbfc7938fc5 for instance with vm_state active and task_state deleting.
Apr 11 19:34:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:15 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Instance destroyed successfully.
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.objects.instance [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'resources' on Instance uuid 6802f099-9236-4c79-a892-2963f1b15b0e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1133297397',display_name='tempest-AttachVolumeTestJSON-server-1133297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1133297397',id=15,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOPD4tcuauGjUTVAuhtjF6Ujtk7F6BaqU+NEO4mmGMGLvyjwNgcmLISc53y0YOwfDCzVZpJizbGjjXjSyz46Q14bi5LzbNBxPb/IJFa2O26n4+/fWcXb8RJ3mMBruboVA==',key_name='tempest-keypair-1431410116',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d886d2ec5fc946b49af3c8ca7c8556c7',ramdisk_id='',reservation_id='r-57smpzsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2144032498',owner_user_name='tempest-AttachVolumeTestJSON-2144032498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:32:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31c237e142784bd6aa460d6f1bf33400',uuid=6802f099-9236-4c79-a892-2963f1b15b0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converting VIF {"id": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "address": "fa:16:3e:ce:17:72", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6193819b-0c", "ovs_interfaceid": "6193819b-0c1b-476b-b89e-dbbfc7938fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG os_vif [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6193819b-0c, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:34:15 user nova-compute[82196]: INFO os_vif [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:72,bridge_name='br-int',has_traffic_filtering=True,id=6193819b-0c1b-476b-b89e-dbbfc7938fc5,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6193819b-0c')
Apr 11 19:34:15 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Deleting instance files /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e_del
Apr 11 19:34:15 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Deletion of /opt/stack/data/nova/instances/6802f099-9236-4c79-a892-2963f1b15b0e_del complete
Apr 11 19:34:15 user nova-compute[82196]: INFO nova.compute.manager [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 11 19:34:15 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:34:15 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:34:16 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241641.2620232, cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:34:16 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] VM Stopped (Lifecycle Event)
Apr 11 19:34:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d56f6c48-8984-4965-ad18-9c58707cbb40 None None] [instance: cbd5aa3c-f6c9-49e2-8ee7-dcf389c9ed08] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:34:16 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:34:16 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Took 0.79 seconds to deallocate network for instance.
Apr 11 19:34:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:17 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:34:17 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:34:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:17 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Deleted allocations for instance 6802f099-9236-4c79-a892-2963f1b15b0e
Apr 11 19:34:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dee7959c-7e20-4ddc-b4d5-e2024be3b2d1 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "6802f099-9236-4c79-a892-2963f1b15b0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-2d525ecb-80c6-4cf2-bbe5-38b6fa0f2d43 req-9404ef0c-f600-4c91-b4d4-45fd6b3b1d4d service nova] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Received event network-vif-deleted-6193819b-0c1b-476b-b89e-dbbfc7938fc5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:28 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241653.9900715, 03bb985c-4903-4d0e-98a1-43a9352f4ec6 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:34:28 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] VM Stopped (Lifecycle Event)
Apr 11 19:34:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-417b9e0a-de65-465f-b473-58d9243df1f0 None None] [instance: 03bb985c-4903-4d0e-98a1-43a9352f4ec6] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:34:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:30 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241655.8420265, 6802f099-9236-4c79-a892-2963f1b15b0e => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:34:30 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] VM Stopped (Lifecycle Event)
Apr 11 19:34:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-57d2be89-3bf2-4fd0-953e-4b46595f7078 None None] [instance: 6802f099-9236-4c79-a892-2963f1b15b0e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:34:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:33 user nova-compute[82196]: INFO nova.compute.manager [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Rescuing
Apr 11 19:34:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:34:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquired lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:34:33 user nova-compute[82196]: DEBUG nova.network.neutron [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG nova.network.neutron [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updating instance_info_cache with network_info: [{"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Releasing lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-ecb9c65b-1bef-446c-879b-02216df9fdd2 req-7d156b3a-1a81-41a4-9817-ef37983947db service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-unplugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ecb9c65b-1bef-446c-879b-02216df9fdd2 req-7d156b3a-1a81-41a4-9817-ef37983947db service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ecb9c65b-1bef-446c-879b-02216df9fdd2 req-7d156b3a-1a81-41a4-9817-ef37983947db service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ecb9c65b-1bef-446c-879b-02216df9fdd2 req-7d156b3a-1a81-41a4-9817-ef37983947db service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-ecb9c65b-1bef-446c-879b-02216df9fdd2 req-7d156b3a-1a81-41a4-9817-ef37983947db service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-unplugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:34 user nova-compute[82196]: WARNING nova.compute.manager [req-ecb9c65b-1bef-446c-879b-02216df9fdd2 req-7d156b3a-1a81-41a4-9817-ef37983947db service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received unexpected event network-vif-unplugged-06fea704-e356-4605-811e-aac91617290e for instance with vm_state active and task_state rescuing.
Apr 11 19:34:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:34 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Instance destroyed successfully.
Apr 11 19:34:34 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Attempting rescue
Apr 11 19:34:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82196) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Instance directory exists: not creating {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 19:34:34 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Creating image(s)
Apr 11 19:34:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "/opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "/opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "/opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG nova.objects.instance [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'trusted_certs' on Instance uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.rescue {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.rescue" returned: 0 in 0.057s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'migration_context' on Instance uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Start _get_guest_xml network_info=[{"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "vif_mac": "fa:16:3e:0f:f8:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'resources' on Instance uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'numa_topology' on Instance uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:35 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:34:35 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'vcpu_model' on Instance uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-706054067',display_name='tempest-ServerRescueNegativeTestJSON-server-706054067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-706054067',id=25,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8e3a291c54b49db8e12a88ba41865e3',ramdisk_id='',reservation_id='r-zcw3jruw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1429831687',owner_user_name='tempest-ServerRescueNegativeTestJSON-1429831687-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:29:58Z,user_data=None,user_id='ba7f82b529e74d99838b6264b94d823b',uuid=267c17c1-f0b6-4e18-8c18-5e5bbe8a2251,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "vif_mac": "fa:16:3e:0f:f8:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converting VIF {"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "vif_mac": "fa:16:3e:0f:f8:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=06fea704-e356-4605-811e-aac91617290e,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fea704-e3') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'pci_devices' on Instance uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:34:35 user nova-compute[82196]:   <uuid>267c17c1-f0b6-4e18-8c18-5e5bbe8a2251</uuid>
Apr 11 19:34:35 user nova-compute[82196]:   <name>instance-00000019</name>
Apr 11 19:34:35 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:34:35 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:34:35 user nova-compute[82196]:   <metadata>
Apr 11 19:34:35 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:34:35 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:34:35 user nova-compute[82196]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-706054067</nova:name>
Apr 11 19:34:35 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:34:35</nova:creationTime>
Apr 11 19:34:35 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:34:35 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:34:35 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:34:35 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:34:35 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:34:35 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:34:35 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:34:35 user nova-compute[82196]:       <nova:owner>
Apr 11 19:34:35 user nova-compute[82196]:         <nova:user uuid="ba7f82b529e74d99838b6264b94d823b">tempest-ServerRescueNegativeTestJSON-1429831687-project-member</nova:user>
Apr 11 19:34:35 user nova-compute[82196]:         <nova:project uuid="b8e3a291c54b49db8e12a88ba41865e3">tempest-ServerRescueNegativeTestJSON-1429831687</nova:project>
Apr 11 19:34:35 user nova-compute[82196]:       </nova:owner>
Apr 11 19:34:35 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:34:35 user nova-compute[82196]:       <nova:ports>
Apr 11 19:34:35 user nova-compute[82196]:         <nova:port uuid="06fea704-e356-4605-811e-aac91617290e">
Apr 11 19:34:35 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 19:34:35 user nova-compute[82196]:         </nova:port>
Apr 11 19:34:35 user nova-compute[82196]:       </nova:ports>
Apr 11 19:34:35 user nova-compute[82196]:     </nova:instance>
Apr 11 19:34:35 user nova-compute[82196]:   </metadata>
Apr 11 19:34:35 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:34:35 user nova-compute[82196]:     <system>
Apr 11 19:34:35 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:34:35 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:34:35 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:34:35 user nova-compute[82196]:       <entry name="serial">267c17c1-f0b6-4e18-8c18-5e5bbe8a2251</entry>
Apr 11 19:34:35 user nova-compute[82196]:       <entry name="uuid">267c17c1-f0b6-4e18-8c18-5e5bbe8a2251</entry>
Apr 11 19:34:35 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:34:35 user nova-compute[82196]:     </system>
Apr 11 19:34:35 user nova-compute[82196]:   </sysinfo>
Apr 11 19:34:35 user nova-compute[82196]:   <os>
Apr 11 19:34:35 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:34:35 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:34:35 user nova-compute[82196]:   </os>
Apr 11 19:34:35 user nova-compute[82196]:   <features>
Apr 11 19:34:35 user nova-compute[82196]:     <acpi/>
Apr 11 19:34:35 user nova-compute[82196]:     <apic/>
Apr 11 19:34:35 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:34:35 user nova-compute[82196]:   </features>
Apr 11 19:34:35 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:34:35 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:34:35 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:34:35 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:34:35 user nova-compute[82196]:   </clock>
Apr 11 19:34:35 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:34:35 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:34:35 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:34:35 user nova-compute[82196]:   </cpu>
Apr 11 19:34:35 user nova-compute[82196]:   <devices>
Apr 11 19:34:35 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:34:35 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:34:35 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.rescue"/>
Apr 11 19:34:35 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:34:35 user nova-compute[82196]:     </disk>
Apr 11 19:34:35 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:34:35 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:34:35 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk"/>
Apr 11 19:34:35 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:34:35 user nova-compute[82196]:     </disk>
Apr 11 19:34:35 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:34:35 user nova-compute[82196]:       <mac address="fa:16:3e:0f:f8:7f"/>
Apr 11 19:34:35 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:34:35 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:34:35 user nova-compute[82196]:       <target dev="tap06fea704-e3"/>
Apr 11 19:34:35 user nova-compute[82196]:     </interface>
Apr 11 19:34:35 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:34:35 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/console.log" append="off"/>
Apr 11 19:34:35 user nova-compute[82196]:     </serial>
Apr 11 19:34:35 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:34:35 user nova-compute[82196]:     <video>
Apr 11 19:34:35 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:34:35 user nova-compute[82196]:     </video>
Apr 11 19:34:35 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:34:35 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:34:35 user nova-compute[82196]:     </rng>
Apr 11 19:34:35 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:34:35 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:34:35 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:34:35 user nova-compute[82196]:     </memballoon>
Apr 11 19:34:35 user nova-compute[82196]:   </devices>
Apr 11 19:34:35 user nova-compute[82196]: </domain>
Apr 11 19:34:35 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:34:35 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Instance destroyed successfully.
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No VIF found with MAC fa:16:3e:0f:f8:7f, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:34:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-29b21c0c-e602-4248-b72c-ecd9d684604c req-152702d8-c5af-48ff-859b-305d8c0282aa service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-29b21c0c-e602-4248-b72c-ecd9d684604c req-152702d8-c5af-48ff-859b-305d8c0282aa service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-29b21c0c-e602-4248-b72c-ecd9d684604c req-152702d8-c5af-48ff-859b-305d8c0282aa service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-29b21c0c-e602-4248-b72c-ecd9d684604c req-152702d8-c5af-48ff-859b-305d8c0282aa service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-29b21c0c-e602-4248-b72c-ecd9d684604c req-152702d8-c5af-48ff-859b-305d8c0282aa service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:36 user nova-compute[82196]: WARNING nova.compute.manager [req-29b21c0c-e602-4248-b72c-ecd9d684604c req-152702d8-c5af-48ff-859b-305d8c0282aa service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received unexpected event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e for instance with vm_state active and task_state rescuing.
Apr 11 19:34:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:38 user nova-compute[82196]: WARNING nova.compute.manager [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received unexpected event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e for instance with vm_state active and task_state rescuing.
Apr 11 19:34:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:38 user nova-compute[82196]: WARNING nova.compute.manager [req-c93e716c-806d-43cd-a19c-e7c834dffed6 req-56dd9f9c-172c-4020-9718-ab8c82b5eb75 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received unexpected event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e for instance with vm_state active and task_state rescuing.
Apr 11 19:34:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241678.6664813, 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:34:38 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] VM Resumed (Lifecycle Event)
Apr 11 19:34:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-773009d8-b992-409b-a39b-6e309a6350d2 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:34:38 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 19:34:38 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241678.669866, 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:34:38 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] VM Started (Lifecycle Event)
Apr 11 19:34:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:34:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:34:39 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:34:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:34:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:34:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:34:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:34:43 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:34:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:34:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:34:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:34:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:34:43 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:34:43 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:44 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Updating instance_info_cache with network_info: [{"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:34:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:34:44 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:34:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:34:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:45 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:34:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:48 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:34:48 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7933MB free_disk=26.276832580566406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance e6e3640a-c262-4e2d-a994-2e4312f22871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance b079367a-558e-4920-ad8d-972a8065260c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:34:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:51 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:34:51 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:34:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "e6e3640a-c262-4e2d-a994-2e4312f22871" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:52 user nova-compute[82196]: INFO nova.compute.manager [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Terminating instance
Apr 11 19:34:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-60c5830a-a630-473c-83fd-a243fc2e58dd req-67f8ec37-e865-4bd5-a2f9-504f3c9bbbd5 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Received event network-vif-unplugged-183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-60c5830a-a630-473c-83fd-a243fc2e58dd req-67f8ec37-e865-4bd5-a2f9-504f3c9bbbd5 service nova] Acquiring lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-60c5830a-a630-473c-83fd-a243fc2e58dd req-67f8ec37-e865-4bd5-a2f9-504f3c9bbbd5 service nova] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-60c5830a-a630-473c-83fd-a243fc2e58dd req-67f8ec37-e865-4bd5-a2f9-504f3c9bbbd5 service nova] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-60c5830a-a630-473c-83fd-a243fc2e58dd req-67f8ec37-e865-4bd5-a2f9-504f3c9bbbd5 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] No waiting events found dispatching network-vif-unplugged-183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-60c5830a-a630-473c-83fd-a243fc2e58dd req-67f8ec37-e865-4bd5-a2f9-504f3c9bbbd5 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Received event network-vif-unplugged-183a0478-c117-4fe1-acce-22e4aee440c9 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:34:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:53 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Instance destroyed successfully.
Apr 11 19:34:53 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lazy-loading 'resources' on Instance uuid e6e3640a-c262-4e2d-a994-2e4312f22871 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:34:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2097763810',display_name='tempest-AttachVolumeNegativeTest-server-2097763810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2097763810',id=27,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHn6VY0TWifqU3p1evbu+EX6BdhcRbf171BBoRu2Zek2ZxhXI3fsfWd4X4kA8GA+fpWd9lKaJGwEU1M4JEXSRotTTW+C0bM2tFJUQlcVplgUGzjC/IH04gthMYmR1rcXA==',key_name='tempest-keypair-2085079067',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:32:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06966e2f4d3a4dec92282c7ad348635d',ramdisk_id='',reservation_id='r-ju2ed407',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-303418642',owner_user_name='tempest-AttachVolumeNegativeTest-303418642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d405421ceb4d99967ef2e7f55e7809',uuid=e6e3640a-c262-4e2d-a994-2e4312f22871,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "183a0478-c117-4fe1-acce-22e4aee440c9", "address": "fa:16:3e:6c:3e:6d", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183a0478-c1", "ovs_interfaceid": "183a0478-c117-4fe1-acce-22e4aee440c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:34:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converting VIF {"id": "183a0478-c117-4fe1-acce-22e4aee440c9", "address": "fa:16:3e:6c:3e:6d", "network": {"id": "fb39619b-a298-4b28-9280-3fc309c5a229", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-686584793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06966e2f4d3a4dec92282c7ad348635d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183a0478-c1", "ovs_interfaceid": "183a0478-c117-4fe1-acce-22e4aee440c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:34:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:3e:6d,bridge_name='br-int',has_traffic_filtering=True,id=183a0478-c117-4fe1-acce-22e4aee440c9,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183a0478-c1') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:34:53 user nova-compute[82196]: DEBUG os_vif [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:3e:6d,bridge_name='br-int',has_traffic_filtering=True,id=183a0478-c117-4fe1-acce-22e4aee440c9,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183a0478-c1') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:34:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap183a0478-c1, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:34:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:34:53 user nova-compute[82196]: INFO os_vif [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:3e:6d,bridge_name='br-int',has_traffic_filtering=True,id=183a0478-c117-4fe1-acce-22e4aee440c9,network=Network(fb39619b-a298-4b28-9280-3fc309c5a229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183a0478-c1')
Apr 11 19:34:53 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Deleting instance files /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871_del
Apr 11 19:34:53 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Deletion of /opt/stack/data/nova/instances/e6e3640a-c262-4e2d-a994-2e4312f22871_del complete
Apr 11 19:34:53 user nova-compute[82196]: INFO nova.compute.manager [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 19:34:53 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:34:53 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:34:53 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:34:54 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:34:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-78fee767-2a6a-4026-98e5-56f1fb7b184b req-1ebb266d-d627-4e6f-8348-1da4d4e49914 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Received event network-vif-deleted-183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:54 user nova-compute[82196]: INFO nova.compute.manager [req-78fee767-2a6a-4026-98e5-56f1fb7b184b req-1ebb266d-d627-4e6f-8348-1da4d4e49914 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Neutron deleted interface 183a0478-c117-4fe1-acce-22e4aee440c9; detaching it from the instance and deleting it from the info cache
Apr 11 19:34:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-78fee767-2a6a-4026-98e5-56f1fb7b184b req-1ebb266d-d627-4e6f-8348-1da4d4e49914 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:34:54 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Took 1.32 seconds to deallocate network for instance.
Apr 11 19:34:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-78fee767-2a6a-4026-98e5-56f1fb7b184b req-1ebb266d-d627-4e6f-8348-1da4d4e49914 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Detach interface failed, port_id=183a0478-c117-4fe1-acce-22e4aee440c9, reason: Instance e6e3640a-c262-4e2d-a994-2e4312f22871 could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:34:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-00d4c2f2-b4b2-4da2-a385-ebe3b812a32c req-8f822912-353e-46c0-aa8d-bf6a67cd2c14 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Received event network-vif-plugged-183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-00d4c2f2-b4b2-4da2-a385-ebe3b812a32c req-8f822912-353e-46c0-aa8d-bf6a67cd2c14 service nova] Acquiring lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-00d4c2f2-b4b2-4da2-a385-ebe3b812a32c req-8f822912-353e-46c0-aa8d-bf6a67cd2c14 service nova] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-00d4c2f2-b4b2-4da2-a385-ebe3b812a32c req-8f822912-353e-46c0-aa8d-bf6a67cd2c14 service nova] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-00d4c2f2-b4b2-4da2-a385-ebe3b812a32c req-8f822912-353e-46c0-aa8d-bf6a67cd2c14 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] No waiting events found dispatching network-vif-plugged-183a0478-c117-4fe1-acce-22e4aee440c9 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:34:54 user nova-compute[82196]: WARNING nova.compute.manager [req-00d4c2f2-b4b2-4da2-a385-ebe3b812a32c req-8f822912-353e-46c0-aa8d-bf6a67cd2c14 service nova] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Received unexpected event network-vif-plugged-183a0478-c117-4fe1-acce-22e4aee440c9 for instance with vm_state deleted and task_state None.
Apr 11 19:34:55 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:34:55 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:34:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:55 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Deleted allocations for instance e6e3640a-c262-4e2d-a994-2e4312f22871
Apr 11 19:34:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6086418a-8d60-4e33-8310-5440d33d09ef tempest-AttachVolumeNegativeTest-303418642 tempest-AttachVolumeNegativeTest-303418642-project-member] Lock "e6e3640a-c262-4e2d-a994-2e4312f22871" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.629s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "afc22926-012a-43fe-99e6-063294c593a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "afc22926-012a-43fe-99e6-063294c593a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:34:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:34:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:34:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:34:55 user nova-compute[82196]: INFO nova.compute.claims [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Claim successful on node user
Apr 11 19:34:56 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:34:56 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:34:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:34:56 user nova-compute[82196]: INFO nova.virt.block_device [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Booting with volume cfa96911-0869-4a41-97fe-ebf8f5bf1574 at /dev/vda
Apr 11 19:34:56 user nova-compute[82196]: DEBUG nova.policy [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG os_brick.utils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65501cb-ea8c-4585-bfdf-e50079336c33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5fbf60-3182-447b-b68d-ca8beb3c5aa1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfbbb79-4a61-4f40-ab34-1f738b6a68e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f7b953-3ac9-4885-ab91-65f145a3b7ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:34:56 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:34:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e4e28-1169-439a-9918-fa4c1ec38e12]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG os_brick.utils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Updating existing volume attachment record: 6f71f75d-88c0-4002-8188-db5ca6b205e3 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:34:56 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Successfully created port: 8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:34:57 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Successfully updated port: 8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:34:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "refresh_cache-afc22926-012a-43fe-99e6-063294c593a6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:34:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquired lock "refresh_cache-afc22926-012a-43fe-99e6-063294c593a6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:34:57 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:34:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received event network-changed-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:34:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Refreshing instance network info cache due to event network-changed-8491f5dc-f77b-491b-b24f-19791271647d. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:34:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] Acquiring lock "refresh_cache-afc22926-012a-43fe-99e6-063294c593a6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:34:57 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:34:58 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Updating instance_info_cache with network_info: [{"id": "8491f5dc-f77b-491b-b24f-19791271647d", "address": "fa:16:3e:db:3f:6a", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491f5dc-f7", "ovs_interfaceid": "8491f5dc-f77b-491b-b24f-19791271647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:34:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Releasing lock "refresh_cache-afc22926-012a-43fe-99e6-063294c593a6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:34:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Instance network_info: |[{"id": "8491f5dc-f77b-491b-b24f-19791271647d", "address": "fa:16:3e:db:3f:6a", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491f5dc-f7", "ovs_interfaceid": "8491f5dc-f77b-491b-b24f-19791271647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:34:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] Acquired lock "refresh_cache-afc22926-012a-43fe-99e6-063294c593a6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:34:58 user nova-compute[82196]: DEBUG nova.network.neutron [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Refreshing network info cache for port 8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:34:58 user nova-compute[82196]: DEBUG nova.network.neutron [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Updated VIF entry in instance network info cache for port 8491f5dc-f77b-491b-b24f-19791271647d. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:34:58 user nova-compute[82196]: DEBUG nova.network.neutron [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Updating instance_info_cache with network_info: [{"id": "8491f5dc-f77b-491b-b24f-19791271647d", "address": "fa:16:3e:db:3f:6a", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491f5dc-f7", "ovs_interfaceid": "8491f5dc-f77b-491b-b24f-19791271647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:34:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:34:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2fded05f-3b6b-4694-aa53-1eef5869c726 req-9a0dc307-efe4-4711-9c2b-ff968a80db26 service nova] Releasing lock "refresh_cache-afc22926-012a-43fe-99e6-063294c593a6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:34:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:35:00 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Creating image(s)
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Ensure instance console log exists: /opt/stack/data/nova/instances/afc22926-012a-43fe-99e6-063294c593a6/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Start _get_guest_xml network_info=[{"id": "8491f5dc-f77b-491b-b24f-19791271647d", "address": "fa:16:3e:db:3f:6a", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491f5dc-f7", "ovs_interfaceid": "8491f5dc-f77b-491b-b24f-19791271647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adnVFifR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'afc22926-012a-43fe-99e6-063294c593a6', 'attached_at': '', 'detached_at': '', 'volume_id': 'cfa96911-0869-4a41-97fe-ebf8f5bf1574', 'serial': 'cfa96911-0869-4a41-97fe-ebf8f5bf1574'}, 'attachment_id': '6f71f75d-88c0-4002-8188-db5ca6b205e3', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:35:00 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:35:00 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adnVFifR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:35:00 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:35:00 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:35:00 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbc24d1-df7e-4684-89a8-21f99ac525a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:35:00 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1184b1-fc7f-4451-bca7-196120b49dd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574] added
Apr 11 19:35:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b46fbb-536e-4eb7-b846-d8add03a46f7]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec450ce-8743-40b4-8b5f-cc67e8297672]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v adnVFifR {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v adnVFifR" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bded49-b573-45ff-b5f2-d5f616886549]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'adnVFifR'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfebe2e3-6e9b-4d8b-89a4-09cd05f93904]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[91726a5b-8249-4bdf-8450-1e76f8bab7f1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[92310818-b8c9-4967-a21b-f11ada1d032f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574, portal: 172.16.0.220,3260]
Apr 11 19:35:00 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574, portal: 172.16.0.220,3260] successful.
Apr 11 19:35:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a9c680-904d-468c-9d07-f70df92cd361]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a501ece-065b-44c1-aa2d-24fe45992437]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:00 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:35:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:35:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:00 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:35:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:35:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:35:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:35:01 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:35:01 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:35:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5fcdfe-1ebb-4e9b-a1e4-dcc9b9caa14e]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:01 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:35:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adnVFifR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23765623834363837', 'path': '/dev/sdc'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765623834363837', 'path': '/dev/sdc'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-96679831',display_name='tempest-TestVolumeBootPattern-volume-backed-server-96679831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-96679831',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-nrrck3pw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:34:56Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=afc22926-012a-43fe-99e6-063294c593a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8491f5dc-f77b-491b-b24f-19791271647d", "address": "fa:16:3e:db:3f:6a", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491f5dc-f7", "ovs_interfaceid": "8491f5dc-f77b-491b-b24f-19791271647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "8491f5dc-f77b-491b-b24f-19791271647d", "address": "fa:16:3e:db:3f:6a", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491f5dc-f7", "ovs_interfaceid": "8491f5dc-f77b-491b-b24f-19791271647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3f:6a,bridge_name='br-int',has_traffic_filtering=True,id=8491f5dc-f77b-491b-b24f-19791271647d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491f5dc-f7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lazy-loading 'pci_devices' on Instance uuid afc22926-012a-43fe-99e6-063294c593a6 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:35:02 user nova-compute[82196]:   <uuid>afc22926-012a-43fe-99e6-063294c593a6</uuid>
Apr 11 19:35:02 user nova-compute[82196]:   <name>instance-00000020</name>
Apr 11 19:35:02 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:35:02 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:35:02 user nova-compute[82196]:   <metadata>
Apr 11 19:35:02 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:35:02 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:35:02 user nova-compute[82196]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-96679831</nova:name>
Apr 11 19:35:02 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:35:00</nova:creationTime>
Apr 11 19:35:02 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:35:02 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:35:02 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:35:02 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:35:02 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:35:02 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:35:02 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:35:02 user nova-compute[82196]:       <nova:owner>
Apr 11 19:35:02 user nova-compute[82196]:         <nova:user uuid="cf262cd03f4a41c4956d8784cf37d86d">tempest-TestVolumeBootPattern-935343500-project-member</nova:user>
Apr 11 19:35:02 user nova-compute[82196]:         <nova:project uuid="2caba0618fc743e7bfb2dd866a511df9">tempest-TestVolumeBootPattern-935343500</nova:project>
Apr 11 19:35:02 user nova-compute[82196]:       </nova:owner>
Apr 11 19:35:02 user nova-compute[82196]:       <nova:ports>
Apr 11 19:35:02 user nova-compute[82196]:         <nova:port uuid="8491f5dc-f77b-491b-b24f-19791271647d">
Apr 11 19:35:02 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 19:35:02 user nova-compute[82196]:         </nova:port>
Apr 11 19:35:02 user nova-compute[82196]:       </nova:ports>
Apr 11 19:35:02 user nova-compute[82196]:     </nova:instance>
Apr 11 19:35:02 user nova-compute[82196]:   </metadata>
Apr 11 19:35:02 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:35:02 user nova-compute[82196]:     <system>
Apr 11 19:35:02 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:35:02 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:35:02 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:35:02 user nova-compute[82196]:       <entry name="serial">afc22926-012a-43fe-99e6-063294c593a6</entry>
Apr 11 19:35:02 user nova-compute[82196]:       <entry name="uuid">afc22926-012a-43fe-99e6-063294c593a6</entry>
Apr 11 19:35:02 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:35:02 user nova-compute[82196]:     </system>
Apr 11 19:35:02 user nova-compute[82196]:   </sysinfo>
Apr 11 19:35:02 user nova-compute[82196]:   <os>
Apr 11 19:35:02 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:35:02 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:35:02 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:35:02 user nova-compute[82196]:   </os>
Apr 11 19:35:02 user nova-compute[82196]:   <features>
Apr 11 19:35:02 user nova-compute[82196]:     <acpi/>
Apr 11 19:35:02 user nova-compute[82196]:     <apic/>
Apr 11 19:35:02 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:35:02 user nova-compute[82196]:   </features>
Apr 11 19:35:02 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:35:02 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:35:02 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:35:02 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:35:02 user nova-compute[82196]:   </clock>
Apr 11 19:35:02 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:35:02 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:35:02 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:35:02 user nova-compute[82196]:   </cpu>
Apr 11 19:35:02 user nova-compute[82196]:   <devices>
Apr 11 19:35:02 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:35:02 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:35:02 user nova-compute[82196]:       <source dev="/dev/sdc"/>
Apr 11 19:35:02 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:35:02 user nova-compute[82196]:       <serial>cfa96911-0869-4a41-97fe-ebf8f5bf1574</serial>
Apr 11 19:35:02 user nova-compute[82196]:     </disk>
Apr 11 19:35:02 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:35:02 user nova-compute[82196]:       <mac address="fa:16:3e:db:3f:6a"/>
Apr 11 19:35:02 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:35:02 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:35:02 user nova-compute[82196]:       <target dev="tap8491f5dc-f7"/>
Apr 11 19:35:02 user nova-compute[82196]:     </interface>
Apr 11 19:35:02 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:35:02 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/afc22926-012a-43fe-99e6-063294c593a6/console.log" append="off"/>
Apr 11 19:35:02 user nova-compute[82196]:     </serial>
Apr 11 19:35:02 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:35:02 user nova-compute[82196]:     <video>
Apr 11 19:35:02 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:35:02 user nova-compute[82196]:     </video>
Apr 11 19:35:02 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:35:02 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:35:02 user nova-compute[82196]:     </rng>
Apr 11 19:35:02 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:35:02 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:35:02 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:35:02 user nova-compute[82196]:     </memballoon>
Apr 11 19:35:02 user nova-compute[82196]:   </devices>
Apr 11 19:35:02 user nova-compute[82196]: </domain>
Apr 11 19:35:02 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-96679831',display_name='tempest-TestVolumeBootPattern-volume-backed-server-96679831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-96679831',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-nrrck3pw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:34:56Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=afc22926-012a-43fe-99e6-063294c593a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8491f5dc-f77b-491b-b24f-19791271647d", "address": "fa:16:3e:db:3f:6a", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491f5dc-f7", "ovs_interfaceid": "8491f5dc-f77b-491b-b24f-19791271647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "8491f5dc-f77b-491b-b24f-19791271647d", "address": "fa:16:3e:db:3f:6a", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491f5dc-f7", "ovs_interfaceid": "8491f5dc-f77b-491b-b24f-19791271647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3f:6a,bridge_name='br-int',has_traffic_filtering=True,id=8491f5dc-f77b-491b-b24f-19791271647d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491f5dc-f7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG os_vif [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3f:6a,bridge_name='br-int',has_traffic_filtering=True,id=8491f5dc-f77b-491b-b24f-19791271647d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491f5dc-f7') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8491f5dc-f7, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8491f5dc-f7, col_values=(('external_ids', {'iface-id': '8491f5dc-f77b-491b-b24f-19791271647d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:3f:6a', 'vm-uuid': 'afc22926-012a-43fe-99e6-063294c593a6'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:02 user nova-compute[82196]: INFO os_vif [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3f:6a,bridge_name='br-int',has_traffic_filtering=True,id=8491f5dc-f77b-491b-b24f-19791271647d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491f5dc-f7')
Apr 11 19:35:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:35:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] No VIF found with MAC fa:16:3e:db:3f:6a, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:35:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:03 user nova-compute[82196]: DEBUG nova.compute.manager [req-3640d549-22b1-4442-8c35-ed7a5465bc46 req-8b2bc96b-7a0e-4ad5-826b-efa528d6a444 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received event network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3640d549-22b1-4442-8c35-ed7a5465bc46 req-8b2bc96b-7a0e-4ad5-826b-efa528d6a444 service nova] Acquiring lock "afc22926-012a-43fe-99e6-063294c593a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3640d549-22b1-4442-8c35-ed7a5465bc46 req-8b2bc96b-7a0e-4ad5-826b-efa528d6a444 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3640d549-22b1-4442-8c35-ed7a5465bc46 req-8b2bc96b-7a0e-4ad5-826b-efa528d6a444 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:03 user nova-compute[82196]: DEBUG nova.compute.manager [req-3640d549-22b1-4442-8c35-ed7a5465bc46 req-8b2bc96b-7a0e-4ad5-826b-efa528d6a444 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] No waiting events found dispatching network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:35:03 user nova-compute[82196]: WARNING nova.compute.manager [req-3640d549-22b1-4442-8c35-ed7a5465bc46 req-8b2bc96b-7a0e-4ad5-826b-efa528d6a444 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received unexpected event network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d for instance with vm_state building and task_state spawning.
Apr 11 19:35:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241705.5592897, afc22926-012a-43fe-99e6-063294c593a6 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:35:05 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: afc22926-012a-43fe-99e6-063294c593a6] VM Resumed (Lifecycle Event)
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:35:05 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: afc22926-012a-43fe-99e6-063294c593a6] Instance spawned successfully.
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: afc22926-012a-43fe-99e6-063294c593a6] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: afc22926-012a-43fe-99e6-063294c593a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:05 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: afc22926-012a-43fe-99e6-063294c593a6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241705.5603151, afc22926-012a-43fe-99e6-063294c593a6 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:35:05 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: afc22926-012a-43fe-99e6-063294c593a6] VM Started (Lifecycle Event)
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: afc22926-012a-43fe-99e6-063294c593a6] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: afc22926-012a-43fe-99e6-063294c593a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-8df607cc-023a-4f77-9cde-16d740e5ce15 req-c776e41c-1aca-4054-be30-a38c3e4b1423 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received event network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8df607cc-023a-4f77-9cde-16d740e5ce15 req-c776e41c-1aca-4054-be30-a38c3e4b1423 service nova] Acquiring lock "afc22926-012a-43fe-99e6-063294c593a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8df607cc-023a-4f77-9cde-16d740e5ce15 req-c776e41c-1aca-4054-be30-a38c3e4b1423 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8df607cc-023a-4f77-9cde-16d740e5ce15 req-c776e41c-1aca-4054-be30-a38c3e4b1423 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-8df607cc-023a-4f77-9cde-16d740e5ce15 req-c776e41c-1aca-4054-be30-a38c3e4b1423 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] No waiting events found dispatching network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:35:05 user nova-compute[82196]: WARNING nova.compute.manager [req-8df607cc-023a-4f77-9cde-16d740e5ce15 req-c776e41c-1aca-4054-be30-a38c3e4b1423 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received unexpected event network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d for instance with vm_state building and task_state spawning.
Apr 11 19:35:05 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: afc22926-012a-43fe-99e6-063294c593a6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:35:05 user nova-compute[82196]: INFO nova.compute.manager [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Took 4.99 seconds to spawn the instance on the hypervisor.
Apr 11 19:35:05 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:05 user nova-compute[82196]: INFO nova.compute.manager [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Took 9.95 seconds to build instance.
Apr 11 19:35:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3f55a066-d3cc-4187-b323-ac8f2fc57fa5 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "afc22926-012a-43fe-99e6-063294c593a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.040s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:07 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "5d000531-5884-405d-9e17-1dc5f39226d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "5d000531-5884-405d-9e17-1dc5f39226d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:35:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:35:07 user nova-compute[82196]: INFO nova.compute.claims [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Claim successful on node user
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:35:08 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.policy [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20f337feb0ed4653976ace530bfdd877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5246cf04a7401388cba38d16e298ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241693.4085643, e6e3640a-c262-4e2d-a994-2e4312f22871 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:35:08 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] VM Stopped (Lifecycle Event)
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:35:08 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Creating image(s)
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "/opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "/opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-38cee980-5b9d-4dec-8073-37edd87375b0 None None] [instance: e6e3640a-c262-4e2d-a994-2e4312f22871] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.165s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk 1073741824" returned: 0 in 0.049s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:08 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Successfully created port: 0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Cannot resize image /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'migration_context' on Instance uuid 5d000531-5884-405d-9e17-1dc5f39226d0 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Ensure instance console log exists: /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:35:09 user nova-compute[82196]: INFO nova.compute.claims [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Claim successful on node user
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Successfully updated port: 0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "refresh_cache-5d000531-5884-405d-9e17-1dc5f39226d0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquired lock "refresh_cache-5d000531-5884-405d-9e17-1dc5f39226d0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.compute.manager [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Received event network-changed-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.compute.manager [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Refreshing instance network info cache due to event network-changed-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] Acquiring lock "refresh_cache-5d000531-5884-405d-9e17-1dc5f39226d0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:35:10 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.policy [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31c237e142784bd6aa460d6f1bf33400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd886d2ec5fc946b49af3c8ca7c8556c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:35:10 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Creating image(s)
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "/opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "/opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Updating instance_info_cache with network_info: [{"id": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "address": "fa:16:3e:7a:2b:e5", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff284fa-eb", "ovs_interfaceid": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Releasing lock "refresh_cache-5d000531-5884-405d-9e17-1dc5f39226d0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Instance network_info: |[{"id": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "address": "fa:16:3e:7a:2b:e5", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff284fa-eb", "ovs_interfaceid": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] Acquired lock "refresh_cache-5d000531-5884-405d-9e17-1dc5f39226d0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Refreshing network info cache for port 0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Start _get_guest_xml network_info=[{"id": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "address": "fa:16:3e:7a:2b:e5", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff284fa-eb", "ovs_interfaceid": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:35:10 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:35:10 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-90407416',display_name='tempest-VolumesSnapshotTestJSON-instance-90407416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-90407416',id=33,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d5246cf04a7401388cba38d16e298ae',ramdisk_id='',reservation_id='r-4k8706hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-111705993',owner_user_name='tempest-VolumesSnapshotTestJSON-111705993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:35:08Z,user_data=None,user_id='20f337feb0ed4653976ace530bfdd877',uuid=5d000531-5884-405d-9e17-1dc5f39226d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "address": "fa:16:3e:7a:2b:e5", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff284fa-eb", "ovs_interfaceid": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Converting VIF {"id": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "address": "fa:16:3e:7a:2b:e5", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff284fa-eb", "ovs_interfaceid": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2b:e5,bridge_name='br-int',has_traffic_filtering=True,id=0ff284fa-ebe1-4fe5-9942-7d57a7bb641a,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ff284fa-eb') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d000531-5884-405d-9e17-1dc5f39226d0 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.168s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:35:10 user nova-compute[82196]:   <uuid>5d000531-5884-405d-9e17-1dc5f39226d0</uuid>
Apr 11 19:35:10 user nova-compute[82196]:   <name>instance-00000021</name>
Apr 11 19:35:10 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:35:10 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:35:10 user nova-compute[82196]:   <metadata>
Apr 11 19:35:10 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:35:10 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:35:10 user nova-compute[82196]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-90407416</nova:name>
Apr 11 19:35:10 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:35:10</nova:creationTime>
Apr 11 19:35:10 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:35:10 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:35:10 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:35:10 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:35:10 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:35:10 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:35:10 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:35:10 user nova-compute[82196]:       <nova:owner>
Apr 11 19:35:10 user nova-compute[82196]:         <nova:user uuid="20f337feb0ed4653976ace530bfdd877">tempest-VolumesSnapshotTestJSON-111705993-project-member</nova:user>
Apr 11 19:35:10 user nova-compute[82196]:         <nova:project uuid="6d5246cf04a7401388cba38d16e298ae">tempest-VolumesSnapshotTestJSON-111705993</nova:project>
Apr 11 19:35:10 user nova-compute[82196]:       </nova:owner>
Apr 11 19:35:10 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:35:10 user nova-compute[82196]:       <nova:ports>
Apr 11 19:35:10 user nova-compute[82196]:         <nova:port uuid="0ff284fa-ebe1-4fe5-9942-7d57a7bb641a">
Apr 11 19:35:10 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 19:35:10 user nova-compute[82196]:         </nova:port>
Apr 11 19:35:10 user nova-compute[82196]:       </nova:ports>
Apr 11 19:35:10 user nova-compute[82196]:     </nova:instance>
Apr 11 19:35:10 user nova-compute[82196]:   </metadata>
Apr 11 19:35:10 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:35:10 user nova-compute[82196]:     <system>
Apr 11 19:35:10 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:35:10 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:35:10 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:35:10 user nova-compute[82196]:       <entry name="serial">5d000531-5884-405d-9e17-1dc5f39226d0</entry>
Apr 11 19:35:10 user nova-compute[82196]:       <entry name="uuid">5d000531-5884-405d-9e17-1dc5f39226d0</entry>
Apr 11 19:35:10 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:35:10 user nova-compute[82196]:     </system>
Apr 11 19:35:10 user nova-compute[82196]:   </sysinfo>
Apr 11 19:35:10 user nova-compute[82196]:   <os>
Apr 11 19:35:10 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:35:10 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:35:10 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:35:10 user nova-compute[82196]:   </os>
Apr 11 19:35:10 user nova-compute[82196]:   <features>
Apr 11 19:35:10 user nova-compute[82196]:     <acpi/>
Apr 11 19:35:10 user nova-compute[82196]:     <apic/>
Apr 11 19:35:10 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:35:10 user nova-compute[82196]:   </features>
Apr 11 19:35:10 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:35:10 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:35:10 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:35:10 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:35:10 user nova-compute[82196]:   </clock>
Apr 11 19:35:10 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:35:10 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:35:10 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:35:10 user nova-compute[82196]:   </cpu>
Apr 11 19:35:10 user nova-compute[82196]:   <devices>
Apr 11 19:35:10 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:35:10 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:35:10 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk"/>
Apr 11 19:35:10 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:35:10 user nova-compute[82196]:     </disk>
Apr 11 19:35:10 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:35:10 user nova-compute[82196]:       <mac address="fa:16:3e:7a:2b:e5"/>
Apr 11 19:35:10 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:35:10 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:35:10 user nova-compute[82196]:       <target dev="tap0ff284fa-eb"/>
Apr 11 19:35:10 user nova-compute[82196]:     </interface>
Apr 11 19:35:10 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:35:10 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/console.log" append="off"/>
Apr 11 19:35:10 user nova-compute[82196]:     </serial>
Apr 11 19:35:10 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:35:10 user nova-compute[82196]:     <video>
Apr 11 19:35:10 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:35:10 user nova-compute[82196]:     </video>
Apr 11 19:35:10 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:35:10 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:35:10 user nova-compute[82196]:     </rng>
Apr 11 19:35:10 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:35:10 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:35:10 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:35:10 user nova-compute[82196]:     </memballoon>
Apr 11 19:35:10 user nova-compute[82196]:   </devices>
Apr 11 19:35:10 user nova-compute[82196]: </domain>
Apr 11 19:35:10 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-90407416',display_name='tempest-VolumesSnapshotTestJSON-instance-90407416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-90407416',id=33,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d5246cf04a7401388cba38d16e298ae',ramdisk_id='',reservation_id='r-4k8706hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-111705993',owner_user_name='tempest-VolumesSnapshotTestJSON-111705993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:35:08Z,user_data=None,user_id='20f337feb0ed4653976ace530bfdd877',uuid=5d000531-5884-405d-9e17-1dc5f39226d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "address": "fa:16:3e:7a:2b:e5", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff284fa-eb", "ovs_interfaceid": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Converting VIF {"id": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "address": "fa:16:3e:7a:2b:e5", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff284fa-eb", "ovs_interfaceid": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2b:e5,bridge_name='br-int',has_traffic_filtering=True,id=0ff284fa-ebe1-4fe5-9942-7d57a7bb641a,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ff284fa-eb') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG os_vif [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2b:e5,bridge_name='br-int',has_traffic_filtering=True,id=0ff284fa-ebe1-4fe5-9942-7d57a7bb641a,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ff284fa-eb') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ff284fa-eb, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ff284fa-eb, col_values=(('external_ids', {'iface-id': '0ff284fa-ebe1-4fe5-9942-7d57a7bb641a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:2b:e5', 'vm-uuid': '5d000531-5884-405d-9e17-1dc5f39226d0'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:10 user nova-compute[82196]: INFO os_vif [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2b:e5,bridge_name='br-int',has_traffic_filtering=True,id=0ff284fa-ebe1-4fe5-9942-7d57a7bb641a,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ff284fa-eb')
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk 1073741824" returned: 0 in 0.053s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] No VIF found with MAC fa:16:3e:7a:2b:e5, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Successfully created port: ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Cannot resize image /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.objects.instance [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'migration_context' on Instance uuid bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Ensure instance console log exists: /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.network.neutron [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Updated VIF entry in instance network info cache for port 0ff284fa-ebe1-4fe5-9942-7d57a7bb641a. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.network.neutron [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Updating instance_info_cache with network_info: [{"id": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "address": "fa:16:3e:7a:2b:e5", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff284fa-eb", "ovs_interfaceid": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0d01936c-ee5d-4684-848a-fcd61c4c551c req-cef5e749-4c40-431c-953e-528f753620e5 service nova] Releasing lock "refresh_cache-5d000531-5884-405d-9e17-1dc5f39226d0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Successfully updated port: ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "refresh_cache-bd559e67-3c8f-42b4-b1d6-fd171c8850b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquired lock "refresh_cache-bd559e67-3c8f-42b4-b1d6-fd171c8850b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Received event network-changed-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Refreshing instance network info cache due to event network-changed-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] Acquiring lock "refresh_cache-bd559e67-3c8f-42b4-b1d6-fd171c8850b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Updating instance_info_cache with network_info: [{"id": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "address": "fa:16:3e:0c:56:f8", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9fd5c5-52", "ovs_interfaceid": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Releasing lock "refresh_cache-bd559e67-3c8f-42b4-b1d6-fd171c8850b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.compute.manager [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Instance network_info: |[{"id": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "address": "fa:16:3e:0c:56:f8", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9fd5c5-52", "ovs_interfaceid": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] Acquired lock "refresh_cache-bd559e67-3c8f-42b4-b1d6-fd171c8850b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.network.neutron [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Refreshing network info cache for port ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Start _get_guest_xml network_info=[{"id": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "address": "fa:16:3e:0c:56:f8", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9fd5c5-52", "ovs_interfaceid": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:35:11 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:35:11 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:35:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-239003632',display_name='tempest-AttachVolumeTestJSON-server-239003632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-239003632',id=34,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj5U4wRknz1MMM6VxHMYJlHXKjuSjf0vHEAMH6+Udiac3pru4iQbtKDLsL6uIMSU8FT7pn+fHTrDxPsnf9BfAtyaZLT+gR1T3aHFQYwoKhwFOr64bBxhyIiMbG8SlmhFw==',key_name='tempest-keypair-1741457082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d886d2ec5fc946b49af3c8ca7c8556c7',ramdisk_id='',reservation_id='r-02cds3yg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2144032498',owner_user_name='tempest-AttachVolumeTestJSON-2144032498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:35:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31c237e142784bd6aa460d6f1bf33400',uuid=bd559e67-3c8f-42b4-b1d6-fd171c8850b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "address": "fa:16:3e:0c:56:f8", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9fd5c5-52", "ovs_interfaceid": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converting VIF {"id": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "address": "fa:16:3e:0c:56:f8", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9fd5c5-52", "ovs_interfaceid": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:56:f8,bridge_name='br-int',has_traffic_filtering=True,id=ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9fd5c5-52') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:35:11 user nova-compute[82196]: DEBUG nova.objects.instance [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'pci_devices' on Instance uuid bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:35:12 user nova-compute[82196]:   <uuid>bd559e67-3c8f-42b4-b1d6-fd171c8850b8</uuid>
Apr 11 19:35:12 user nova-compute[82196]:   <name>instance-00000022</name>
Apr 11 19:35:12 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:35:12 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:35:12 user nova-compute[82196]:   <metadata>
Apr 11 19:35:12 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:35:12 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:35:12 user nova-compute[82196]:       <nova:name>tempest-AttachVolumeTestJSON-server-239003632</nova:name>
Apr 11 19:35:12 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:35:11</nova:creationTime>
Apr 11 19:35:12 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:35:12 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:35:12 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:35:12 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:35:12 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:35:12 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:35:12 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:35:12 user nova-compute[82196]:       <nova:owner>
Apr 11 19:35:12 user nova-compute[82196]:         <nova:user uuid="31c237e142784bd6aa460d6f1bf33400">tempest-AttachVolumeTestJSON-2144032498-project-member</nova:user>
Apr 11 19:35:12 user nova-compute[82196]:         <nova:project uuid="d886d2ec5fc946b49af3c8ca7c8556c7">tempest-AttachVolumeTestJSON-2144032498</nova:project>
Apr 11 19:35:12 user nova-compute[82196]:       </nova:owner>
Apr 11 19:35:12 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:35:12 user nova-compute[82196]:       <nova:ports>
Apr 11 19:35:12 user nova-compute[82196]:         <nova:port uuid="ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2">
Apr 11 19:35:12 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:35:12 user nova-compute[82196]:         </nova:port>
Apr 11 19:35:12 user nova-compute[82196]:       </nova:ports>
Apr 11 19:35:12 user nova-compute[82196]:     </nova:instance>
Apr 11 19:35:12 user nova-compute[82196]:   </metadata>
Apr 11 19:35:12 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:35:12 user nova-compute[82196]:     <system>
Apr 11 19:35:12 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:35:12 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:35:12 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:35:12 user nova-compute[82196]:       <entry name="serial">bd559e67-3c8f-42b4-b1d6-fd171c8850b8</entry>
Apr 11 19:35:12 user nova-compute[82196]:       <entry name="uuid">bd559e67-3c8f-42b4-b1d6-fd171c8850b8</entry>
Apr 11 19:35:12 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:35:12 user nova-compute[82196]:     </system>
Apr 11 19:35:12 user nova-compute[82196]:   </sysinfo>
Apr 11 19:35:12 user nova-compute[82196]:   <os>
Apr 11 19:35:12 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:35:12 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:35:12 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:35:12 user nova-compute[82196]:   </os>
Apr 11 19:35:12 user nova-compute[82196]:   <features>
Apr 11 19:35:12 user nova-compute[82196]:     <acpi/>
Apr 11 19:35:12 user nova-compute[82196]:     <apic/>
Apr 11 19:35:12 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:35:12 user nova-compute[82196]:   </features>
Apr 11 19:35:12 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:35:12 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:35:12 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:35:12 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:35:12 user nova-compute[82196]:   </clock>
Apr 11 19:35:12 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:35:12 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:35:12 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:35:12 user nova-compute[82196]:   </cpu>
Apr 11 19:35:12 user nova-compute[82196]:   <devices>
Apr 11 19:35:12 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:35:12 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:35:12 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk"/>
Apr 11 19:35:12 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:35:12 user nova-compute[82196]:     </disk>
Apr 11 19:35:12 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:35:12 user nova-compute[82196]:       <mac address="fa:16:3e:0c:56:f8"/>
Apr 11 19:35:12 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:35:12 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:35:12 user nova-compute[82196]:       <target dev="taped9fd5c5-52"/>
Apr 11 19:35:12 user nova-compute[82196]:     </interface>
Apr 11 19:35:12 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:35:12 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/console.log" append="off"/>
Apr 11 19:35:12 user nova-compute[82196]:     </serial>
Apr 11 19:35:12 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:35:12 user nova-compute[82196]:     <video>
Apr 11 19:35:12 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:35:12 user nova-compute[82196]:     </video>
Apr 11 19:35:12 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:35:12 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:35:12 user nova-compute[82196]:     </rng>
Apr 11 19:35:12 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:35:12 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:35:12 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:35:12 user nova-compute[82196]:     </memballoon>
Apr 11 19:35:12 user nova-compute[82196]:   </devices>
Apr 11 19:35:12 user nova-compute[82196]: </domain>
Apr 11 19:35:12 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:35:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-239003632',display_name='tempest-AttachVolumeTestJSON-server-239003632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-239003632',id=34,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj5U4wRknz1MMM6VxHMYJlHXKjuSjf0vHEAMH6+Udiac3pru4iQbtKDLsL6uIMSU8FT7pn+fHTrDxPsnf9BfAtyaZLT+gR1T3aHFQYwoKhwFOr64bBxhyIiMbG8SlmhFw==',key_name='tempest-keypair-1741457082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d886d2ec5fc946b49af3c8ca7c8556c7',ramdisk_id='',reservation_id='r-02cds3yg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2144032498',owner_user_name='tempest-AttachVolumeTestJSON-2144032498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:35:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31c237e142784bd6aa460d6f1bf33400',uuid=bd559e67-3c8f-42b4-b1d6-fd171c8850b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "address": "fa:16:3e:0c:56:f8", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9fd5c5-52", "ovs_interfaceid": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converting VIF {"id": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "address": "fa:16:3e:0c:56:f8", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9fd5c5-52", "ovs_interfaceid": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:56:f8,bridge_name='br-int',has_traffic_filtering=True,id=ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9fd5c5-52') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG os_vif [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:56:f8,bridge_name='br-int',has_traffic_filtering=True,id=ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9fd5c5-52') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped9fd5c5-52, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped9fd5c5-52, col_values=(('external_ids', {'iface-id': 'ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:56:f8', 'vm-uuid': 'bd559e67-3c8f-42b4-b1d6-fd171c8850b8'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:12 user nova-compute[82196]: INFO os_vif [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:56:f8,bridge_name='br-int',has_traffic_filtering=True,id=ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9fd5c5-52')
Apr 11 19:35:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-d1f61cba-8dbd-4357-b971-c167497448ec req-1699885c-c34d-43ef-9f57-4943c55f7153 service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Received event network-vif-plugged-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d1f61cba-8dbd-4357-b971-c167497448ec req-1699885c-c34d-43ef-9f57-4943c55f7153 service nova] Acquiring lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d1f61cba-8dbd-4357-b971-c167497448ec req-1699885c-c34d-43ef-9f57-4943c55f7153 service nova] Lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d1f61cba-8dbd-4357-b971-c167497448ec req-1699885c-c34d-43ef-9f57-4943c55f7153 service nova] Lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-d1f61cba-8dbd-4357-b971-c167497448ec req-1699885c-c34d-43ef-9f57-4943c55f7153 service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] No waiting events found dispatching network-vif-plugged-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:35:12 user nova-compute[82196]: WARNING nova.compute.manager [req-d1f61cba-8dbd-4357-b971-c167497448ec req-1699885c-c34d-43ef-9f57-4943c55f7153 service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Received unexpected event network-vif-plugged-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a for instance with vm_state building and task_state spawning.
Apr 11 19:35:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No VIF found with MAC fa:16:3e:0c:56:f8, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG nova.network.neutron [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Updated VIF entry in instance network info cache for port ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG nova.network.neutron [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Updating instance_info_cache with network_info: [{"id": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "address": "fa:16:3e:0c:56:f8", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9fd5c5-52", "ovs_interfaceid": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:35:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5de0b140-909a-4ca2-b847-9fd3fa1dffdd req-bdd62476-ac9d-4ca7-9354-5354ec0ff719 service nova] Releasing lock "refresh_cache-bd559e67-3c8f-42b4-b1d6-fd171c8850b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:35:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-72842ccf-141f-45ff-aa32-94e3236c7a5e req-f35b9568-e50e-4f70-a268-81a687cf2882 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Received event network-vif-plugged-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-72842ccf-141f-45ff-aa32-94e3236c7a5e req-f35b9568-e50e-4f70-a268-81a687cf2882 service nova] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-72842ccf-141f-45ff-aa32-94e3236c7a5e req-f35b9568-e50e-4f70-a268-81a687cf2882 service nova] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-72842ccf-141f-45ff-aa32-94e3236c7a5e req-f35b9568-e50e-4f70-a268-81a687cf2882 service nova] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-72842ccf-141f-45ff-aa32-94e3236c7a5e req-f35b9568-e50e-4f70-a268-81a687cf2882 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] No waiting events found dispatching network-vif-plugged-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:35:13 user nova-compute[82196]: WARNING nova.compute.manager [req-72842ccf-141f-45ff-aa32-94e3236c7a5e req-f35b9568-e50e-4f70-a268-81a687cf2882 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Received unexpected event network-vif-plugged-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 for instance with vm_state building and task_state spawning.
Apr 11 19:35:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-26da59a5-ada1-45b7-b9c2-7ebf527aeb85 req-70a89b86-2e09-4a7e-bf35-bac81376be9b service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Received event network-vif-plugged-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-26da59a5-ada1-45b7-b9c2-7ebf527aeb85 req-70a89b86-2e09-4a7e-bf35-bac81376be9b service nova] Acquiring lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-26da59a5-ada1-45b7-b9c2-7ebf527aeb85 req-70a89b86-2e09-4a7e-bf35-bac81376be9b service nova] Lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-26da59a5-ada1-45b7-b9c2-7ebf527aeb85 req-70a89b86-2e09-4a7e-bf35-bac81376be9b service nova] Lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-26da59a5-ada1-45b7-b9c2-7ebf527aeb85 req-70a89b86-2e09-4a7e-bf35-bac81376be9b service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] No waiting events found dispatching network-vif-plugged-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:35:14 user nova-compute[82196]: WARNING nova.compute.manager [req-26da59a5-ada1-45b7-b9c2-7ebf527aeb85 req-70a89b86-2e09-4a7e-bf35-bac81376be9b service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Received unexpected event network-vif-plugged-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a for instance with vm_state building and task_state spawning.
Apr 11 19:35:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241715.0899868, 5d000531-5884-405d-9e17-1dc5f39226d0 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] VM Resumed (Lifecycle Event)
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Instance spawned successfully.
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241715.093428, 5d000531-5884-405d-9e17-1dc5f39226d0 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] VM Started (Lifecycle Event)
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.compute.manager [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Took 6.78 seconds to spawn the instance on the hypervisor.
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.compute.manager [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Took 7.55 seconds to build instance.
Apr 11 19:35:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ef04d3b5-eea6-4f46-8dd7-af6736ebcd5f tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "5d000531-5884-405d-9e17-1dc5f39226d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.661s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241715.6577206, bd559e67-3c8f-42b4-b1d6-fd171c8850b8 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] VM Resumed (Lifecycle Event)
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Instance spawned successfully.
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241715.65862, bd559e67-3c8f-42b4-b1d6-fd171c8850b8 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] VM Started (Lifecycle Event)
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-ead1efcc-92bc-47ca-a236-5facc4dfd527 req-79ae127b-13d5-41a9-9d0c-3ab6fa48bed3 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Received event network-vif-plugged-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ead1efcc-92bc-47ca-a236-5facc4dfd527 req-79ae127b-13d5-41a9-9d0c-3ab6fa48bed3 service nova] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ead1efcc-92bc-47ca-a236-5facc4dfd527 req-79ae127b-13d5-41a9-9d0c-3ab6fa48bed3 service nova] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ead1efcc-92bc-47ca-a236-5facc4dfd527 req-79ae127b-13d5-41a9-9d0c-3ab6fa48bed3 service nova] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-ead1efcc-92bc-47ca-a236-5facc4dfd527 req-79ae127b-13d5-41a9-9d0c-3ab6fa48bed3 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] No waiting events found dispatching network-vif-plugged-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:35:15 user nova-compute[82196]: WARNING nova.compute.manager [req-ead1efcc-92bc-47ca-a236-5facc4dfd527 req-79ae127b-13d5-41a9-9d0c-3ab6fa48bed3 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Received unexpected event network-vif-plugged-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 for instance with vm_state building and task_state spawning.
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.compute.manager [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Took 5.62 seconds to spawn the instance on the hypervisor.
Apr 11 19:35:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:15 user nova-compute[82196]: INFO nova.compute.manager [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Took 6.36 seconds to build instance.
Apr 11 19:35:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-17d6d4fa-b1a9-46f5-9f0a-449cea91d951 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.462s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'flavor' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:27 user nova-compute[82196]: INFO nova.compute.manager [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Attaching volume 8f069dda-26af-4766-b53f-0a831de5011e to /dev/vdb
Apr 11 19:35:27 user nova-compute[82196]: DEBUG os_brick.utils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6a012e-45c7-4d1c-b504-ac957eb6dd25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[877b1048-8e07-41a5-bc7a-73752b58eb07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[687f5236-6e79-4a92-8619-df401a098284]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e2d2ce-1134-415d-9bf5-5e907f65b73a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:35:27 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:35:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8c3ba3-b2fc-4621-9ccd-1ac7a6fbde56]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG os_brick.utils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:35:27 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating existing volume attachment record: dad287f3-12ab-4c13-b974-8720d9427c9d {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:35:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlutpRPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:35:32 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:35:32 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:35:32 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab36124-da72-4427-89bc-b0ada418b343]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:35:32 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe936dd-94bd-4029-8b55-b37838e03561]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e] added
Apr 11 19:35:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[699ce475-6feb-407b-b296-b1d8b984e0a9]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e940f505-5788-4ba6-839e-bc341b6207b6]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlutpRPK {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlutpRPK" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0276aa2c-5257-4bbb-817d-da2e773be43e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WlutpRPK'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5874c5f-4644-4a58-b75a-d9fb0ac2a3bf]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb7f09f-9608-4bc8-b981-f468cf19ec7c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:32 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:35:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:32 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:35:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[03113422-74e1-48b2-98c2-a3a54316fc3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260]
Apr 11 19:35:32 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260] successful.
Apr 11 19:35:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e29293e-0101-41a0-93f9-d8cb1c7cbe84]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b163ff96-bde1-4ce7-9ab0-843a2ea0222b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:32 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:35:32 user nova-compute[82196]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:35:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:32 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:35:32 user nova-compute[82196]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:35:32 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caa9187-a93d-43d0-a9b9-a2f8651b8928]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:32 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:35:33 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:35:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlutpRPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:35:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:35:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23630633066396163', 'path': '/dev/sdd'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:35:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630633066396163', 'path': '/dev/sdd'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:35:33 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'flavor' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:35:33 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:35:33 user nova-compute[82196]:   <source dev="/dev/sdd"/>
Apr 11 19:35:33 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:35:33 user nova-compute[82196]:   <serial>8f069dda-26af-4766-b53f-0a831de5011e</serial>
Apr 11 19:35:33 user nova-compute[82196]: </disk>
Apr 11 19:35:33 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:35:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:35:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:35:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No VIF found with MAC fa:16:3e:7a:ec:62, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:35:33 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3dec674a-fb88-4332-a982-a0779ca9e195 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.226s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Stashing vm_state: active {{(pid=82196) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 19:35:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'pci_requests' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:35:35 user nova-compute[82196]: INFO nova.compute.claims [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Claim successful on node user
Apr 11 19:35:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'resources' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:35 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'pci_devices' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:35 user nova-compute[82196]: INFO nova.compute.resource_tracker [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating resource usage from migration 3c4e7cb9-5bf3-43f1-9585-8956cde90edb
Apr 11 19:35:36 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.465s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:36 user nova-compute[82196]: INFO nova.compute.manager [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Migrating
Apr 11 19:35:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquired lock "compute-rpcapi-router" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:35:36 user nova-compute[82196]: INFO nova.compute.rpcapi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 11 19:35:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Releasing lock "compute-rpcapi-router" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquired lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating instance_info_cache with network_info: [{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Releasing lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Starting migrate_disk_and_power_off {{(pid=82196) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG nova.compute.manager [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-unplugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG nova.compute.manager [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-unplugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:35:37 user nova-compute[82196]: WARNING nova.compute.manager [req-40375c82-1cbb-49eb-a44d-b36c19dba8a8 req-5b323136-b6bc-4c89-b58b-657680d63aa2 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-unplugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state active and task_state resize_migrating.
Apr 11 19:35:37 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance destroyed successfully.
Apr 11 19:35:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-505347267',display_name='tempest-ServerActionsTestJSON-server-1599172202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-505347267',id=21,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:30:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-lxpjy0l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=647674d8-af53-405a-8116-4b7a01549bdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:7a:ec:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:7a:ec:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_vif [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4e4888a-16, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:35:37 user nova-compute[82196]: INFO os_vif [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16')
Apr 11 19:35:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlutpRPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:35:37 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fbe9e5-85fd-44a6-9ff0-570840ef5bed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:35:37 user nova-compute[82196]: No targets found.
Apr 11 19:35:37 user nova-compute[82196]: iSNS:
Apr 11 19:35:37 user nova-compute[82196]: No targets found.
Apr 11 19:35:37 user nova-compute[82196]: STATIC:
Apr 11 19:35:37 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574
Apr 11 19:35:37 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:35:37 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:35:37 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:35:37 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:35:37 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:35:37 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e
Apr 11 19:35:37 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:35:37 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:35:37 user nova-compute[82196]: FIRMWARE:
Apr 11 19:35:37 user nova-compute[82196]: No targets found.
Apr 11 19:35:37 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:35:37 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:35:37 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b18fe81-7e3c-4831-8790-1af39bc91ba6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[243f5ec0-2c3b-48ab-8905-5e743abedd20]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:37 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:35:37 user nova-compute[82196]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:35:37 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:37 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:35:37 user nova-compute[82196]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:35:37 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9281a8a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e'): ({'sdd'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Removing single pathed devices sdd {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a84ce1-411c-472b-a590-6dad6c9e5bf8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d82ceb-2359-477b-bd7d-afc256e20b3c]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flushing IO for device /dev/sdd {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[becb63f6-1c24-4200-8768-c18d418cefe2]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5bdced-8247-48ea-94dd-9d3018bd75b3]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e70fb9-f265-47be-8826-b2dfd6b574e2]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce25326-48f5-460d-abf0-e5dbb370b618]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260]
Apr 11 19:35:37 user nova-compute[82196]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260] successful.
Apr 11 19:35:37 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[68119fd5-0092-4e50-8778-f4e37d0096b4]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== disconnect_volume: return (288ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:35:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:38 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:35:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf_resize/disk /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "cp -r /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf_resize/disk /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk" returned: 0 in 0.242s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf_resize/disk.info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk.info {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:38 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "cp -r /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf_resize/disk.info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk.info" returned: 0 in 0.037s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:39 user nova-compute[82196]: DEBUG nova.compute.manager [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:39 user nova-compute[82196]: DEBUG nova.compute.manager [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:35:39 user nova-compute[82196]: WARNING nova.compute.manager [req-c14eb386-efc5-4c68-a558-a528dedf9f86 req-b9e6e570-b73d-4091-82a8-58f2f1db4a95 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state active and task_state resize_migrating.
Apr 11 19:35:39 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Port e4e4888a-168a-4fe8-a43e-ee683b50a39a binding to destination host user is already ACTIVE {{(pid=82196) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 19:35:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:35:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquired lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:35:39 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating instance_info_cache with network_info: [{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Releasing lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG os_brick.utils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69a203a-1d66-46d8-a2bf-4f61c9cc599d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9bf3f9-d53c-4f61-a25a-d58043184702]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ac7084-242c-4785-bbef-e9ca94e9481f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[de20808c-7de2-4a42-8efc-f3562b04c8b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:35:40 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:35:40 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[037d298b-0586-4558-bdc4-97eef67ccf96]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:35:40 user nova-compute[82196]: DEBUG os_brick.utils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:35:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:35:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:35:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:43 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:35:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:35:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:35:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:35:43 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:35:44 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating instance_info_cache with network_info: [{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:35:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:35:44 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:35:44 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:35:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Starting finish_migration {{(pid=82196) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 19:35:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance directory exists: not creating {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 19:35:44 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Creating image(s)
Apr 11 19:35:44 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'trusted_certs' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:44 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:35:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Cannot resize image /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Ensure instance console log exists: /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Start _get_guest_xml network_info=[{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:7a:ec:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlutpRPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '647674d8-af53-405a-8116-4b7a01549bdf', 'attached_at': '2023-04-11T19:35:44.000000', 'detached_at': '', 'volume_id': '8f069dda-26af-4766-b53f-0a831de5011e', 'serial': '8f069dda-26af-4766-b53f-0a831de5011e'}, 'attachment_id': '32f72c6a-848a-401b-9f12-6198de75b7c0', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:35:45 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:35:45 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:19:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'vcpu_model' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlutpRPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:35:45 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:35:45 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:35:45 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dd12ab-0f85-4135-a3fd-51fba6e6f161]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:35:45 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5481c64f-fa37-46ed-9c7c-104bc6ae21d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e] added
Apr 11 19:35:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d7ee25-b98d-4008-a098-d63c95d0cd14]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a7c109-5289-471a-b970-1f88c83db245]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlutpRPK {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlutpRPK" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bc0246-af91-46cf-92b5-548bb22fb039]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WlutpRPK'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced6b99a-8d28-4ca0-a35a-22ed9c23f8bd]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0158d04-be14-49c8-9ce2-578c0788f15a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:45 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:35:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:45 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:35:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[222a7326-c63c-40fd-8b1e-a9b5c4c537f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260]
Apr 11 19:35:45 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260] successful.
Apr 11 19:35:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f69a9-b8c6-4fef-a8d9-b5f6a9ad2734]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac15a43-c8f2-4b8c-8543-ac5808c47816]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:45 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:35:45 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:35:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:35:45 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:35:45 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:35:45 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3662f88-c34c-44b6-8284-90142f7fc077]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:35:45 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlutpRPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23630633066396163', 'path': '/dev/sdd'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630633066396163', 'path': '/dev/sdd'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-505347267',display_name='tempest-ServerActionsTestJSON-server-1599172202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-505347267',id=21,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:30:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-lxpjy0l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:35:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=647674d8-af53-405a-8116-4b7a01549bdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:7a:ec:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:7a:ec:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:35:46 user nova-compute[82196]:   <uuid>647674d8-af53-405a-8116-4b7a01549bdf</uuid>
Apr 11 19:35:46 user nova-compute[82196]:   <name>instance-00000015</name>
Apr 11 19:35:46 user nova-compute[82196]:   <memory>196608</memory>
Apr 11 19:35:46 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:35:46 user nova-compute[82196]:   <metadata>
Apr 11 19:35:46 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:35:46 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:35:46 user nova-compute[82196]:       <nova:name>tempest-ServerActionsTestJSON-server-1599172202</nova:name>
Apr 11 19:35:46 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:35:45</nova:creationTime>
Apr 11 19:35:46 user nova-compute[82196]:       <nova:flavor name="m1.micro">
Apr 11 19:35:46 user nova-compute[82196]:         <nova:memory>192</nova:memory>
Apr 11 19:35:46 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:35:46 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:35:46 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:35:46 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:35:46 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:35:46 user nova-compute[82196]:       <nova:owner>
Apr 11 19:35:46 user nova-compute[82196]:         <nova:user uuid="05fb551c320a48f98a4ec00a7f7492d7">tempest-ServerActionsTestJSON-37730514-project-member</nova:user>
Apr 11 19:35:46 user nova-compute[82196]:         <nova:project uuid="60a7381a31b84e97a068528f90813773">tempest-ServerActionsTestJSON-37730514</nova:project>
Apr 11 19:35:46 user nova-compute[82196]:       </nova:owner>
Apr 11 19:35:46 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:35:46 user nova-compute[82196]:       <nova:ports>
Apr 11 19:35:46 user nova-compute[82196]:         <nova:port uuid="e4e4888a-168a-4fe8-a43e-ee683b50a39a">
Apr 11 19:35:46 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 19:35:46 user nova-compute[82196]:         </nova:port>
Apr 11 19:35:46 user nova-compute[82196]:       </nova:ports>
Apr 11 19:35:46 user nova-compute[82196]:     </nova:instance>
Apr 11 19:35:46 user nova-compute[82196]:   </metadata>
Apr 11 19:35:46 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:35:46 user nova-compute[82196]:     <system>
Apr 11 19:35:46 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:35:46 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:35:46 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:35:46 user nova-compute[82196]:       <entry name="serial">647674d8-af53-405a-8116-4b7a01549bdf</entry>
Apr 11 19:35:46 user nova-compute[82196]:       <entry name="uuid">647674d8-af53-405a-8116-4b7a01549bdf</entry>
Apr 11 19:35:46 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:35:46 user nova-compute[82196]:     </system>
Apr 11 19:35:46 user nova-compute[82196]:   </sysinfo>
Apr 11 19:35:46 user nova-compute[82196]:   <os>
Apr 11 19:35:46 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:35:46 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:35:46 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:35:46 user nova-compute[82196]:   </os>
Apr 11 19:35:46 user nova-compute[82196]:   <features>
Apr 11 19:35:46 user nova-compute[82196]:     <acpi/>
Apr 11 19:35:46 user nova-compute[82196]:     <apic/>
Apr 11 19:35:46 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:35:46 user nova-compute[82196]:   </features>
Apr 11 19:35:46 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:35:46 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:35:46 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:35:46 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:35:46 user nova-compute[82196]:   </clock>
Apr 11 19:35:46 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:35:46 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:35:46 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:35:46 user nova-compute[82196]:   </cpu>
Apr 11 19:35:46 user nova-compute[82196]:   <devices>
Apr 11 19:35:46 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:35:46 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:35:46 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk"/>
Apr 11 19:35:46 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:35:46 user nova-compute[82196]:     </disk>
Apr 11 19:35:46 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:35:46 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:35:46 user nova-compute[82196]:       <source dev="/dev/sdd"/>
Apr 11 19:35:46 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:35:46 user nova-compute[82196]:       <serial>8f069dda-26af-4766-b53f-0a831de5011e</serial>
Apr 11 19:35:46 user nova-compute[82196]:     </disk>
Apr 11 19:35:46 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:35:46 user nova-compute[82196]:       <mac address="fa:16:3e:7a:ec:62"/>
Apr 11 19:35:46 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:35:46 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:35:46 user nova-compute[82196]:       <target dev="tape4e4888a-16"/>
Apr 11 19:35:46 user nova-compute[82196]:     </interface>
Apr 11 19:35:46 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:35:46 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/console.log" append="off"/>
Apr 11 19:35:46 user nova-compute[82196]:     </serial>
Apr 11 19:35:46 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:35:46 user nova-compute[82196]:     <video>
Apr 11 19:35:46 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:35:46 user nova-compute[82196]:     </video>
Apr 11 19:35:46 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:35:46 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:35:46 user nova-compute[82196]:     </rng>
Apr 11 19:35:46 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:35:46 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:35:46 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:35:46 user nova-compute[82196]:     </memballoon>
Apr 11 19:35:46 user nova-compute[82196]:   </devices>
Apr 11 19:35:46 user nova-compute[82196]: </domain>
Apr 11 19:35:46 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-505347267',display_name='tempest-ServerActionsTestJSON-server-1599172202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-505347267',id=21,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:30:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-lxpjy0l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:35:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=647674d8-af53-405a-8116-4b7a01549bdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:7a:ec:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:7a:ec:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG os_vif [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4e4888a-16, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4e4888a-16, col_values=(('external_ids', {'iface-id': 'e4e4888a-168a-4fe8-a43e-ee683b50a39a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:ec:62', 'vm-uuid': '647674d8-af53-405a-8116-4b7a01549bdf'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:46 user nova-compute[82196]: INFO os_vif [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16')
Apr 11 19:35:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No VIF found with MAC fa:16:3e:7a:ec:62, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG nova.compute.manager [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-changed-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG nova.compute.manager [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Refreshing instance network info cache due to event network-changed-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] Acquiring lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] Acquired lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Refreshing network info cache for port 0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updated VIF entry in instance network info cache for port 0be0dfa4-d8ad-4d32-83ab-a090c0f77f34. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updating instance_info_cache with network_info: [{"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-63d1970e-c327-43d1-945f-8364967a2300 req-77d86d4c-0c20-4146-9779-9ee925a7258a service nova] Releasing lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:35:48 user nova-compute[82196]: WARNING nova.compute.manager [req-b7d4318c-e773-4937-8be7-54d01923bb46 req-d322b8ff-0c59-412d-86d4-6c379f038c80 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state active and task_state resize_finish.
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:49 user nova-compute[82196]: INFO nova.compute.manager [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Shelving
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG nova.compute.manager [req-3424712a-e7cd-4d99-8a98-885ad9b89b05 req-ab44d826-0be7-4464-974f-39c0ec9f82e3 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-vif-unplugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3424712a-e7cd-4d99-8a98-885ad9b89b05 req-ab44d826-0be7-4464-974f-39c0ec9f82e3 service nova] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3424712a-e7cd-4d99-8a98-885ad9b89b05 req-ab44d826-0be7-4464-974f-39c0ec9f82e3 service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3424712a-e7cd-4d99-8a98-885ad9b89b05 req-ab44d826-0be7-4464-974f-39c0ec9f82e3 service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:49 user nova-compute[82196]: DEBUG nova.compute.manager [req-3424712a-e7cd-4d99-8a98-885ad9b89b05 req-ab44d826-0be7-4464-974f-39c0ec9f82e3 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] No waiting events found dispatching network-vif-unplugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:35:49 user nova-compute[82196]: WARNING nova.compute.manager [req-3424712a-e7cd-4d99-8a98-885ad9b89b05 req-ab44d826-0be7-4464-974f-39c0ec9f82e3 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received unexpected event network-vif-unplugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance with vm_state active and task_state shelving.
Apr 11 19:35:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.manager [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.manager [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:35:50 user nova-compute[82196]: WARNING nova.compute.manager [req-278d9aaf-4fec-4047-a76d-306eae2c5614 req-e947e901-8789-49b1-8bba-3a8b5e997352 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state active and task_state resize_finish.
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for 647674d8-af53-405a-8116-4b7a01549bdf due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241750.329411, 647674d8-af53-405a-8116-4b7a01549bdf => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:35:50 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] VM Resumed (Lifecycle Event)
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:35:50 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Instance destroyed successfully.
Apr 11 19:35:50 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:35:50 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7701MB free_disk=26.214004516601562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:50 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance running successfully.
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Failed to set time: agent not configured {{(pid=82196) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3323a5ab-1b42-4f9d-b4e1-b4114ac5adc0 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] finish_migration finished successfully. {{(pid=82196) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:35:50 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241750.3341413, 647674d8-af53-405a-8116-4b7a01549bdf => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:35:50 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] VM Started (Lifecycle Event)
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:50 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Beginning cold snapshot process
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:35:50 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Applying migration context for instance 647674d8-af53-405a-8116-4b7a01549bdf as it has an incoming, in-progress migration 3c4e7cb9-5bf3-43f1-9585-8956cde90edb. Migration status is finished {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 19:35:50 user nova-compute[82196]: INFO nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating resource usage from migration 3c4e7cb9-5bf3-43f1-9585-8956cde90edb
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance b079367a-558e-4920-ad8d-972a8065260c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance afc22926-012a-43fe-99e6-063294c593a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 5d000531-5884-405d-9e17-1dc5f39226d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Migration 3c4e7cb9-5bf3-43f1-9585-8956cde90edb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:35:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk /opt/stack/data/nova/instances/snapshots/tmpbbyo9rjr/69542df924d649cfa301b61805c33bae {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:51 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:35:51 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:35:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:35:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk /opt/stack/data/nova/instances/snapshots/tmpbbyo9rjr/69542df924d649cfa301b61805c33bae" returned: 0 in 0.633s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:51 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Snapshot extracted, beginning image upload
Apr 11 19:35:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:51 user nova-compute[82196]: DEBUG nova.compute.manager [req-8c17f1a4-3744-464c-9ccf-a85ebbf7d576 req-2f8d77fd-33c5-4270-b21c-d85b7beb2bdd service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8c17f1a4-3744-464c-9ccf-a85ebbf7d576 req-2f8d77fd-33c5-4270-b21c-d85b7beb2bdd service nova] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8c17f1a4-3744-464c-9ccf-a85ebbf7d576 req-2f8d77fd-33c5-4270-b21c-d85b7beb2bdd service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8c17f1a4-3744-464c-9ccf-a85ebbf7d576 req-2f8d77fd-33c5-4270-b21c-d85b7beb2bdd service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:51 user nova-compute[82196]: DEBUG nova.compute.manager [req-8c17f1a4-3744-464c-9ccf-a85ebbf7d576 req-2f8d77fd-33c5-4270-b21c-d85b7beb2bdd service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] No waiting events found dispatching network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:35:51 user nova-compute[82196]: WARNING nova.compute.manager [req-8c17f1a4-3744-464c-9ccf-a85ebbf7d576 req-2f8d77fd-33c5-4270-b21c-d85b7beb2bdd service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received unexpected event network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 19:35:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:51 user nova-compute[82196]: INFO nova.compute.manager [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] instance snapshotting
Apr 11 19:35:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Beginning live snapshot process
Apr 11 19:35:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:52 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:35:52 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:35:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:35:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json -f qcow2 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json -f qcow2 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:52 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:35:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdn6bvmkg/93c0101e95374d2b9321e3c267fd5ad3.delta 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdn6bvmkg/93c0101e95374d2b9321e3c267fd5ad3.delta 1073741824" returned: 0 in 0.062s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 19:35:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] COPY block job progress, current cursor: 1769472 final cursor: 43778048 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:35:53 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Snapshot image upload complete
Apr 11 19:35:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:53 user nova-compute[82196]: INFO nova.compute.manager [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Shelve offloading
Apr 11 19:35:54 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Instance destroyed successfully.
Apr 11 19:35:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:35:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:35:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquired lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:35:54 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:35:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82196) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 19:35:54 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 19:35:54 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:35:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdn6bvmkg/93c0101e95374d2b9321e3c267fd5ad3.delta /opt/stack/data/nova/instances/snapshots/tmpdn6bvmkg/93c0101e95374d2b9321e3c267fd5ad3 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:35:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdn6bvmkg/93c0101e95374d2b9321e3c267fd5ad3.delta /opt/stack/data/nova/instances/snapshots/tmpdn6bvmkg/93c0101e95374d2b9321e3c267fd5ad3" returned: 0 in 0.302s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:35:54 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Snapshot extracted, beginning image upload
Apr 11 19:35:54 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updating instance_info_cache with network_info: [{"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:35:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Releasing lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:35:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:55 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Instance destroyed successfully.
Apr 11 19:35:55 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'resources' on Instance uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:33:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1228547187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1228547187',id=30,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkkJTr5YuxkpX+fjT2biW1YPqt/B9xeGSfz5eI9idL14cBKKQVv2aWXZgrf6S4OtstSLTh3Ew1HBAxse2BI4QjcaST8i9go9QpbAcGCdV8ckJbY2dhHYp7Im1s1H/H33w==',key_name='tempest-keypair-1296340783',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:34:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8d8b189667e34931aa36149620a036e1',ramdisk_id='',reservation_id='r-jqpowijw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-427928846',owner_user_name='tempest-AttachVolumeShelveTestJSON-427928846-project-member',shelved_at='2023-04-11T19:35:53.911348',shelved_host='user',shelved_image_id='1f15605f-2e27-4a82-9ce5-094469a70dcc'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:35:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0558ba5a2b04d36ba2f2411090cc4e4',uuid=fbfa0825-c7c2-4f04-8c9a-102e238c3816,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converting VIF {"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG os_vif [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0be0dfa4-d8, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:35:55 user nova-compute[82196]: INFO os_vif [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8')
Apr 11 19:35:55 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Deleting instance files /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816_del
Apr 11 19:35:55 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Deletion of /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816_del complete
Apr 11 19:35:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-changed-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Refreshing instance network info cache due to event network-changed-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] Acquiring lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] Acquired lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG nova.network.neutron [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Refreshing network info cache for port 0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:35:55 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Deleted allocations for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816
Apr 11 19:35:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:35:55 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'numa_topology' on Instance uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:35:56 user nova-compute[82196]: DEBUG nova.network.neutron [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updated VIF entry in instance network info cache for port 0be0dfa4-d8ad-4d32-83ab-a090c0f77f34. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:35:56 user nova-compute[82196]: DEBUG nova.network.neutron [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updating instance_info_cache with network_info: [{"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:35:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e641982c-f245-465f-b3d2-a0f72802ce3e req-a059d6f2-02ba-428c-9f44-6352add8c85c service nova] Releasing lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:35:56 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:35:56 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:35:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.955s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a6364f93-8059-4d07-8491-c0f2e12b5840 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.403s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:35:57 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Snapshot image upload complete
Apr 11 19:35:57 user nova-compute[82196]: INFO nova.compute.manager [None req-194005b3-79df-4c8d-bc29-35e92cee9f2d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Took 5.60 seconds to snapshot the instance on the hypervisor.
Apr 11 19:35:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:35:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:05 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241750.0810459, fbfa0825-c7c2-4f04-8c9a-102e238c3816 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:36:05 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] VM Stopped (Lifecycle Event)
Apr 11 19:36:05 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7aa54da5-162a-4186-963b-9b6bbd15322b None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:36:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:36:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:18 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:36:18 user nova-compute[82196]: INFO nova.compute.claims [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Claim successful on node user
Apr 11 19:36:18 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:36:18 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:36:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG nova.network.neutron [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:36:19 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:36:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:36:19 user nova-compute[82196]: INFO nova.virt.block_device [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Booting with volume 199762db-3930-4f05-a4da-15dee19e5418 at /dev/vda
Apr 11 19:36:19 user nova-compute[82196]: DEBUG nova.policy [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68fcdcd3af164195bf0c7da3b8dfecb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b9baa081ca455ea6931b7801c805b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG os_brick.utils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674b69f-a633-4e0f-8fe2-2bb2a8cc7394]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b1c042-06e3-4374-995d-1f9ab37a299b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe1a461-28df-49c6-94e5-b220d8a5bcce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be03e6a-db80-4353-af69-7298263c5837]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:36:19 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:36:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99180a3-31dd-4f62-8e4e-02acff42a7ca]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG os_brick.utils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updating existing volume attachment record: 27097310-3017-43a8-b882-261658235119 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG nova.network.neutron [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Successfully created port: fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:36:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG nova.network.neutron [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Successfully updated port: fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquired lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG nova.network.neutron [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-changed-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Refreshing instance network info cache due to event network-changed-fd43e974-64b6-4605-83cb-11b9cfe58341. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] Acquiring lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG nova.network.neutron [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG nova.network.neutron [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updating instance_info_cache with network_info: [{"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Releasing lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Instance network_info: |[{"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] Acquired lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:36:20 user nova-compute[82196]: DEBUG nova.network.neutron [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Refreshing network info cache for port fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:36:21 user nova-compute[82196]: DEBUG nova.network.neutron [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updated VIF entry in instance network info cache for port fd43e974-64b6-4605-83cb-11b9cfe58341. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:36:21 user nova-compute[82196]: DEBUG nova.network.neutron [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updating instance_info_cache with network_info: [{"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:36:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ca693ff8-6a26-43c9-aa92-bb490dc2502c req-65cc561c-2854-46fe-a3ac-c45035101093 service nova] Releasing lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:36:24 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Creating image(s)
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Ensure instance console log exists: /opt/stack/data/nova/instances/d42dc0ea-4631-44be-8b58-09877280ba2e/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Start _get_guest_xml network_info=[{"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arNXGbxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd42dc0ea-4631-44be-8b58-09877280ba2e', 'attached_at': '', 'detached_at': '', 'volume_id': '199762db-3930-4f05-a4da-15dee19e5418', 'serial': '199762db-3930-4f05-a4da-15dee19e5418'}, 'attachment_id': '27097310-3017-43a8-b882-261658235119', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:36:24 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:36:24 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arNXGbxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:36:24 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:36:24 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:36:24 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c621fc-afa4-4e6d-87d7-9d561e2961d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:36:24 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[044eb3f8-52b2-4ef1-bf1c-9be8c5a8bede]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418] added
Apr 11 19:36:24 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e85ef0f-7e45-4a6e-94d3-e7f0e380808b]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:24 user nova-compute[82196]: INFO nova.compute.manager [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Unrescuing
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquired lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.network.neutron [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c314580a-6663-4d5d-9f44-f46be48af112]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v arNXGbxM {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v arNXGbxM" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4f4400-3593-4ad2-8864-a14761fec8f8]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'arNXGbxM'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a76e09-afee-4c03-ab77-32e7780b59bc]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ccaa34-37c2-4871-80e0-04880c8e81f5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:36:24 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:36:24 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:36:24 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:36:24 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:36:24 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:36:24 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6b2863-0743-40c1-8178-8f5cda6cf7a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260]
Apr 11 19:36:24 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260] successful.
Apr 11 19:36:24 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea1398b-7dbe-4f5d-8657-4a4079bff850]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[430b4004-5e15-4294-8e91-38358bd00c74]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:36:24 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:36:24 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:36:24 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:36:24 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:36:24 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:36:24 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:36:24 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:36:24 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbea39bf-1747-4863-8f17-a03e759705f5]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arNXGbxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.network.neutron [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updating instance_info_cache with network_info: [{"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Releasing lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG nova.objects.instance [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'flavor' on Instance uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-1e09c8f1-7fee-4e2c-a494-57b1497f2daf req-15e15403-6486-4aef-ad10-0db4944d0c20 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-unplugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1e09c8f1-7fee-4e2c-a494-57b1497f2daf req-15e15403-6486-4aef-ad10-0db4944d0c20 service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1e09c8f1-7fee-4e2c-a494-57b1497f2daf req-15e15403-6486-4aef-ad10-0db4944d0c20 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1e09c8f1-7fee-4e2c-a494-57b1497f2daf req-15e15403-6486-4aef-ad10-0db4944d0c20 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-1e09c8f1-7fee-4e2c-a494-57b1497f2daf req-15e15403-6486-4aef-ad10-0db4944d0c20 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-unplugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:36:25 user nova-compute[82196]: WARNING nova.compute.manager [req-1e09c8f1-7fee-4e2c-a494-57b1497f2daf req-15e15403-6486-4aef-ad10-0db4944d0c20 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received unexpected event network-vif-unplugged-06fea704-e356-4605-811e-aac91617290e for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:36:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:25 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Instance destroyed successfully.
Apr 11 19:36:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26166656432353939', 'path': '/dev/sde'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166656432353939', 'path': '/dev/sde'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-63091414',display_name='tempest-TestShelveInstance-server-63091414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-63091414',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWOJEcAet7cYNYxgnjtKjY7EQdZEK+sNwCTk8xWL8WixGkKk2vUONnTt9oMkdV+yembu+c8rHexAl3dfd0YzfkTAZ1D5FG2Y66/ZHnUkpqMPcyP8plrDur+CPwxyvFqNQ==',key_name='tempest-TestShelveInstance-1765937682',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b9baa081ca455ea6931b7801c805b8',ramdisk_id='',reservation_id='r-90gk500j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1694566228',owner_user_name='tempest-TestShelveInstance-1694566228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:36:19Z,user_data=None,user_id='68fcdcd3af164195bf0c7da3b8dfecb7',uuid=d42dc0ea-4631-44be-8b58-09877280ba2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Converting VIF {"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.objects.instance [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lazy-loading 'pci_devices' on Instance uuid d42dc0ea-4631-44be-8b58-09877280ba2e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:36:25 user nova-compute[82196]:   <uuid>d42dc0ea-4631-44be-8b58-09877280ba2e</uuid>
Apr 11 19:36:25 user nova-compute[82196]:   <name>instance-00000023</name>
Apr 11 19:36:25 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:36:25 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:36:25 user nova-compute[82196]:   <metadata>
Apr 11 19:36:25 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:36:25 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:36:25 user nova-compute[82196]:       <nova:name>tempest-TestShelveInstance-server-63091414</nova:name>
Apr 11 19:36:25 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:36:24</nova:creationTime>
Apr 11 19:36:25 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:36:25 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:36:25 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:36:25 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:36:25 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:36:25 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:36:25 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:36:25 user nova-compute[82196]:       <nova:owner>
Apr 11 19:36:25 user nova-compute[82196]:         <nova:user uuid="68fcdcd3af164195bf0c7da3b8dfecb7">tempest-TestShelveInstance-1694566228-project-member</nova:user>
Apr 11 19:36:25 user nova-compute[82196]:         <nova:project uuid="c7b9baa081ca455ea6931b7801c805b8">tempest-TestShelveInstance-1694566228</nova:project>
Apr 11 19:36:25 user nova-compute[82196]:       </nova:owner>
Apr 11 19:36:25 user nova-compute[82196]:       <nova:ports>
Apr 11 19:36:25 user nova-compute[82196]:         <nova:port uuid="fd43e974-64b6-4605-83cb-11b9cfe58341">
Apr 11 19:36:25 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 19:36:25 user nova-compute[82196]:         </nova:port>
Apr 11 19:36:25 user nova-compute[82196]:       </nova:ports>
Apr 11 19:36:25 user nova-compute[82196]:     </nova:instance>
Apr 11 19:36:25 user nova-compute[82196]:   </metadata>
Apr 11 19:36:25 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:36:25 user nova-compute[82196]:     <system>
Apr 11 19:36:25 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:36:25 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:36:25 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:36:25 user nova-compute[82196]:       <entry name="serial">d42dc0ea-4631-44be-8b58-09877280ba2e</entry>
Apr 11 19:36:25 user nova-compute[82196]:       <entry name="uuid">d42dc0ea-4631-44be-8b58-09877280ba2e</entry>
Apr 11 19:36:25 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:36:25 user nova-compute[82196]:     </system>
Apr 11 19:36:25 user nova-compute[82196]:   </sysinfo>
Apr 11 19:36:25 user nova-compute[82196]:   <os>
Apr 11 19:36:25 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:36:25 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:36:25 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:36:25 user nova-compute[82196]:   </os>
Apr 11 19:36:25 user nova-compute[82196]:   <features>
Apr 11 19:36:25 user nova-compute[82196]:     <acpi/>
Apr 11 19:36:25 user nova-compute[82196]:     <apic/>
Apr 11 19:36:25 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:36:25 user nova-compute[82196]:   </features>
Apr 11 19:36:25 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:36:25 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:36:25 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:36:25 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:36:25 user nova-compute[82196]:   </clock>
Apr 11 19:36:25 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:36:25 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:36:25 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:36:25 user nova-compute[82196]:   </cpu>
Apr 11 19:36:25 user nova-compute[82196]:   <devices>
Apr 11 19:36:25 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:36:25 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:36:25 user nova-compute[82196]:       <source dev="/dev/sde"/>
Apr 11 19:36:25 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:36:25 user nova-compute[82196]:       <serial>199762db-3930-4f05-a4da-15dee19e5418</serial>
Apr 11 19:36:25 user nova-compute[82196]:     </disk>
Apr 11 19:36:25 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:36:25 user nova-compute[82196]:       <mac address="fa:16:3e:a4:fd:c3"/>
Apr 11 19:36:25 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:36:25 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:36:25 user nova-compute[82196]:       <target dev="tapfd43e974-64"/>
Apr 11 19:36:25 user nova-compute[82196]:     </interface>
Apr 11 19:36:25 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:36:25 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/d42dc0ea-4631-44be-8b58-09877280ba2e/console.log" append="off"/>
Apr 11 19:36:25 user nova-compute[82196]:     </serial>
Apr 11 19:36:25 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:36:25 user nova-compute[82196]:     <video>
Apr 11 19:36:25 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:36:25 user nova-compute[82196]:     </video>
Apr 11 19:36:25 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:36:25 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:36:25 user nova-compute[82196]:     </rng>
Apr 11 19:36:25 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:36:25 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:36:25 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:36:25 user nova-compute[82196]:     </memballoon>
Apr 11 19:36:25 user nova-compute[82196]:   </devices>
Apr 11 19:36:25 user nova-compute[82196]: </domain>
Apr 11 19:36:25 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-63091414',display_name='tempest-TestShelveInstance-server-63091414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-63091414',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWOJEcAet7cYNYxgnjtKjY7EQdZEK+sNwCTk8xWL8WixGkKk2vUONnTt9oMkdV+yembu+c8rHexAl3dfd0YzfkTAZ1D5FG2Y66/ZHnUkpqMPcyP8plrDur+CPwxyvFqNQ==',key_name='tempest-TestShelveInstance-1765937682',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b9baa081ca455ea6931b7801c805b8',ramdisk_id='',reservation_id='r-90gk500j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1694566228',owner_user_name='tempest-TestShelveInstance-1694566228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:36:19Z,user_data=None,user_id='68fcdcd3af164195bf0c7da3b8dfecb7',uuid=d42dc0ea-4631-44be-8b58-09877280ba2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Converting VIF {"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG os_vif [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd43e974-64, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd43e974-64, col_values=(('external_ids', {'iface-id': 'fd43e974-64b6-4605-83cb-11b9cfe58341', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:fd:c3', 'vm-uuid': 'd42dc0ea-4631-44be-8b58-09877280ba2e'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:25 user nova-compute[82196]: INFO os_vif [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64')
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:36:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] No VIF found with MAC fa:16:3e:a4:fd:c3, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:36:27 user nova-compute[82196]: DEBUG nova.compute.manager [req-42cfa043-3fbd-4382-891f-4535b3536797 req-13d8f5dd-3c6b-4917-975b-4be437bdddd4 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:36:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-42cfa043-3fbd-4382-891f-4535b3536797 req-13d8f5dd-3c6b-4917-975b-4be437bdddd4 service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-42cfa043-3fbd-4382-891f-4535b3536797 req-13d8f5dd-3c6b-4917-975b-4be437bdddd4 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-42cfa043-3fbd-4382-891f-4535b3536797 req-13d8f5dd-3c6b-4917-975b-4be437bdddd4 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:27 user nova-compute[82196]: DEBUG nova.compute.manager [req-42cfa043-3fbd-4382-891f-4535b3536797 req-13d8f5dd-3c6b-4917-975b-4be437bdddd4 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:36:27 user nova-compute[82196]: WARNING nova.compute.manager [req-42cfa043-3fbd-4382-891f-4535b3536797 req-13d8f5dd-3c6b-4917-975b-4be437bdddd4 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received unexpected event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:36:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-ded759d4-c5ed-41a0-a9d2-842004beee63 req-b8946762-0852-4ded-a2f7-f7e7294c20fb service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ded759d4-c5ed-41a0-a9d2-842004beee63 req-b8946762-0852-4ded-a2f7-f7e7294c20fb service nova] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ded759d4-c5ed-41a0-a9d2-842004beee63 req-b8946762-0852-4ded-a2f7-f7e7294c20fb service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ded759d4-c5ed-41a0-a9d2-842004beee63 req-b8946762-0852-4ded-a2f7-f7e7294c20fb service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-ded759d4-c5ed-41a0-a9d2-842004beee63 req-b8946762-0852-4ded-a2f7-f7e7294c20fb service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] No waiting events found dispatching network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:36:28 user nova-compute[82196]: WARNING nova.compute.manager [req-ded759d4-c5ed-41a0-a9d2-842004beee63 req-b8946762-0852-4ded-a2f7-f7e7294c20fb service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received unexpected event network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 for instance with vm_state building and task_state spawning.
Apr 11 19:36:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:36:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:36:29 user nova-compute[82196]: WARNING nova.compute.manager [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received unexpected event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:36:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:36:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:36:29 user nova-compute[82196]: WARNING nova.compute.manager [req-fd2427cc-9396-4636-9aa0-0aee3ecec588 req-b691f770-1c99-4d91-ad14-7c188673df0e service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received unexpected event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:36:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [req-113eb924-c488-4b37-8100-ff90349059bf req-7c8e1cfd-7492-4133-922b-dd9a93e9a6ec service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-113eb924-c488-4b37-8100-ff90349059bf req-7c8e1cfd-7492-4133-922b-dd9a93e9a6ec service nova] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-113eb924-c488-4b37-8100-ff90349059bf req-7c8e1cfd-7492-4133-922b-dd9a93e9a6ec service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-113eb924-c488-4b37-8100-ff90349059bf req-7c8e1cfd-7492-4133-922b-dd9a93e9a6ec service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [req-113eb924-c488-4b37-8100-ff90349059bf req-7c8e1cfd-7492-4133-922b-dd9a93e9a6ec service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] No waiting events found dispatching network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:36:30 user nova-compute[82196]: WARNING nova.compute.manager [req-113eb924-c488-4b37-8100-ff90349059bf req-7c8e1cfd-7492-4133-922b-dd9a93e9a6ec service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received unexpected event network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 for instance with vm_state building and task_state spawning.
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241790.628439, d42dc0ea-4631-44be-8b58-09877280ba2e => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:36:30 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] VM Resumed (Lifecycle Event)
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:36:30 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Instance spawned successfully.
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d75d7aa7-7bfb-4891-b2c2-226422bc7c06 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:36:30 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241790.6364465, d42dc0ea-4631-44be-8b58-09877280ba2e => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:36:30 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] VM Started (Lifecycle Event)
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:30 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241790.6692996, 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:36:30 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] VM Resumed (Lifecycle Event)
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:36:30 user nova-compute[82196]: INFO nova.compute.manager [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Took 6.53 seconds to spawn the instance on the hypervisor.
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241790.6694338, 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:36:30 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] VM Started (Lifecycle Event)
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:36:30 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:36:30 user nova-compute[82196]: INFO nova.compute.manager [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Took 12.30 seconds to build instance.
Apr 11 19:36:30 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-45ed5149-6938-4e29-91d9-f3b5351c8d6e tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.397s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:41 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:36:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:36:43 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:36:43 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:36:44 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:36:44 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:36:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:36:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:36:44 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:36:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Updating instance_info_cache with network_info: [{"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:36:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:36:45 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:36:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:36:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:48 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:36:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:36:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "781f3398-3d54-49a4-a751-60f4fbc5e49a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:36:50 user nova-compute[82196]: INFO nova.compute.claims [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Claim successful on node user
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.642s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:36:51 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:36:51 user nova-compute[82196]: INFO nova.virt.block_device [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Booting with volume snapshot d2b5adf4-495d-4b98-b1eb-159c596e88b3 at /dev/vda
Apr 11 19:36:51 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:36:51 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7695MB free_disk=26.166667938232422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Applying migration context for instance 647674d8-af53-405a-8116-4b7a01549bdf as it has an incoming, in-progress migration 3c4e7cb9-5bf3-43f1-9585-8956cde90edb. Migration status is finished {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 19:36:51 user nova-compute[82196]: INFO nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating resource usage from migration 3c4e7cb9-5bf3-43f1-9585-8956cde90edb
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance b079367a-558e-4920-ad8d-972a8065260c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance afc22926-012a-43fe-99e6-063294c593a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 5d000531-5884-405d-9e17-1dc5f39226d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Migration 3c4e7cb9-5bf3-43f1-9585-8956cde90edb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance d42dc0ea-4631-44be-8b58-09877280ba2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:36:51 user nova-compute[82196]: DEBUG nova.policy [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:36:52 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:36:52 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:36:52 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:36:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Successfully created port: eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Successfully updated port: eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "refresh_cache-781f3398-3d54-49a4-a751-60f4fbc5e49a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquired lock "refresh_cache-781f3398-3d54-49a4-a751-60f4fbc5e49a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Received event network-changed-eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Refreshing instance network info cache due to event network-changed-eb83845b-f94f-422d-9970-c00e62a4b142. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] Acquiring lock "refresh_cache-781f3398-3d54-49a4-a751-60f4fbc5e49a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Updating instance_info_cache with network_info: [{"id": "eb83845b-f94f-422d-9970-c00e62a4b142", "address": "fa:16:3e:68:ac:32", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb83845b-f9", "ovs_interfaceid": "eb83845b-f94f-422d-9970-c00e62a4b142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Releasing lock "refresh_cache-781f3398-3d54-49a4-a751-60f4fbc5e49a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Instance network_info: |[{"id": "eb83845b-f94f-422d-9970-c00e62a4b142", "address": "fa:16:3e:68:ac:32", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb83845b-f9", "ovs_interfaceid": "eb83845b-f94f-422d-9970-c00e62a4b142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] Acquired lock "refresh_cache-781f3398-3d54-49a4-a751-60f4fbc5e49a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:36:53 user nova-compute[82196]: DEBUG nova.network.neutron [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Refreshing network info cache for port eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:36:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Updated VIF entry in instance network info cache for port eb83845b-f94f-422d-9970-c00e62a4b142. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:36:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Updating instance_info_cache with network_info: [{"id": "eb83845b-f94f-422d-9970-c00e62a4b142", "address": "fa:16:3e:68:ac:32", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb83845b-f9", "ovs_interfaceid": "eb83845b-f94f-422d-9970-c00e62a4b142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:36:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b3f93cd6-f08d-4ae5-82d6-963e5230c7ac req-ec3be134-9776-40e7-8091-032a58b23488 service nova] Releasing lock "refresh_cache-781f3398-3d54-49a4-a751-60f4fbc5e49a" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:36:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:36:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:36:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:36:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG os_brick.utils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1e800c-033d-4b7e-ae02-1795da20c6fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4812ec08-0e4a-4a7d-9d71-d9635bcbf399]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f58b981-b582-4ac3-be51-5f01770acebf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a143b2ff-6751-403e-ba21-be9695508caa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:36:57 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c87fc7-d924-4131-b1e4-9366320e5637]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG os_brick.utils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Updating existing volume attachment record: b5c8cc9a-44af-4441-91a8-d0a4884f95a9 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "5d000531-5884-405d-9e17-1dc5f39226d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "5d000531-5884-405d-9e17-1dc5f39226d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:57 user nova-compute[82196]: DEBUG nova.objects.instance [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'flavor' on Instance uuid 5d000531-5884-405d-9e17-1dc5f39226d0 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:36:58 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Ignoring supplied device name: /dev/vdb
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "5d000531-5884-405d-9e17-1dc5f39226d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.514s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "5d000531-5884-405d-9e17-1dc5f39226d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "5d000531-5884-405d-9e17-1dc5f39226d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:58 user nova-compute[82196]: INFO nova.compute.manager [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Attaching volume 2af66735-f8a4-4b22-83ed-fc2180654d38 to /dev/vdb
Apr 11 19:36:58 user nova-compute[82196]: DEBUG os_brick.utils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aa6706-b4c6-4410-98ab-87580748c50b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb0179b-04f1-416d-949f-66e7a06af6ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ad2c29-d5d9-4b50-b8b5-385fe6b2b996]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d659c4cd-a0ae-45cb-b413-9343880f0176]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:36:58 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:36:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd53b658-10bc-4fcf-bcf1-e910eb20e8c6]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG os_brick.utils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:36:58 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Updating existing volume attachment record: 06b7556b-453e-488a-87e4-cf7d09c75c6b {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:36:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:36:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:36:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:36:59 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:36:59 user nova-compute[82196]: INFO nova.compute.claims [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Claim successful on node user
Apr 11 19:36:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:00 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:37:00 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:37:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.598s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:37:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:37:00 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:37:00 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:37:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:37:00 user nova-compute[82196]: INFO nova.virt.block_device [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Booting with volume-backed-image 4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b at /dev/vda
Apr 11 19:37:00 user nova-compute[82196]: DEBUG nova.policy [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b3adca432b04d70818a51d1366f5c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb91586feb3f4a4c84fa8c2183baaf8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:37:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Received event network-changed-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Refreshing instance network info cache due to event network-changed-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:37:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] Acquiring lock "refresh_cache-bd559e67-3c8f-42b4-b1d6-fd171c8850b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:37:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] Acquired lock "refresh_cache-bd559e67-3c8f-42b4-b1d6-fd171c8850b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:37:00 user nova-compute[82196]: DEBUG nova.network.neutron [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Refreshing network info cache for port ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:37:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:01 user nova-compute[82196]: DEBUG nova.network.neutron [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Updated VIF entry in instance network info cache for port ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:37:01 user nova-compute[82196]: DEBUG nova.network.neutron [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Updating instance_info_cache with network_info: [{"id": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "address": "fa:16:3e:0c:56:f8", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9fd5c5-52", "ovs_interfaceid": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:37:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f6cd2c13-2a12-44bd-b083-8c85f25808c9 req-ddc7b39e-069b-4408-8861-6a595335672a service nova] Releasing lock "refresh_cache-bd559e67-3c8f-42b4-b1d6-fd171c8850b8" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:37:01 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Successfully created port: 82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Successfully updated port: 82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "refresh_cache-8c45de50-92bc-467c-9f3d-7e667e1d0bb3" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquired lock "refresh_cache-8c45de50-92bc-467c-9f3d-7e667e1d0bb3" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-changed-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Refreshing instance network info cache due to event network-changed-82ee2878-c477-419c-97ba-9ac4b36dacab. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] Acquiring lock "refresh_cache-8c45de50-92bc-467c-9f3d-7e667e1d0bb3" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:37:02 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Creating image(s)
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Ensure instance console log exists: /opt/stack/data/nova/instances/781f3398-3d54-49a4-a751-60f4fbc5e49a/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Start _get_guest_xml network_info=[{"id": "eb83845b-f94f-422d-9970-c00e62a4b142", "address": "fa:16:3e:68:ac:32", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb83845b-f9", "ovs_interfaceid": "eb83845b-f94f-422d-9970-c00e62a4b142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T19:36:47Z,direct_url=<?>,disk_format='qcow2',id=24fc25bd-3ef8-478b-87dc-434d48415b06,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-812039379',owner='2caba0618fc743e7bfb2dd866a511df9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T19:36:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMpdsYVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '781f3398-3d54-49a4-a751-60f4fbc5e49a', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9c5a627-5807-4f3d-8d02-d01cb358784b', 'serial': 'c9c5a627-5807-4f3d-8d02-d01cb358784b'}, 'attachment_id': 'b5c8cc9a-44af-4441-91a8-d0a4884f95a9', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:37:02 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:37:02 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T19:36:47Z,direct_url=<?>,disk_format='qcow2',id=24fc25bd-3ef8-478b-87dc-434d48415b06,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-812039379',owner='2caba0618fc743e7bfb2dd866a511df9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T19:36:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMpdsYVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:02 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:02 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:02 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70372c1-97b1-419c-9a0a-96d528a9d59b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:37:02 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7724faf5-6d13-408e-a989-8329a53b2d5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b] added
Apr 11 19:37:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7195db3e-55f6-47ba-909d-44977a9e5b6e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbeb475-d385-41f8-84ed-8caf60a7ccbd]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMpdsYVy {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMpdsYVy" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a35216-44d8-4e27-9f51-e9befdea1d2e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMpdsYVy'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[207b4f07-1216-4f84-9119-55e8f66b9e5c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2349784b-0072-4fb0-8e87-d8c913d5e495]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Updating instance_info_cache with network_info: [{"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Releasing lock "refresh_cache-8c45de50-92bc-467c-9f3d-7e667e1d0bb3" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Instance network_info: |[{"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] Acquired lock "refresh_cache-8c45de50-92bc-467c-9f3d-7e667e1d0bb3" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG nova.network.neutron [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Refreshing network info cache for port 82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd3b017-fbc3-4f2c-832d-d5a529644afb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b, portal: 172.16.0.220,3260]
Apr 11 19:37:02 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b, portal: 172.16.0.220,3260] successful.
Apr 11 19:37:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec19b23a-2c0e-4c31-842c-d4e6313cad7b]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8183a3f3-3389-4665-b50e-25eeb909a609]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:02 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c31629-d3bb-4769-bdff-ad8c435b13d3]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMpdsYVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:02 user nova-compute[82196]: INFO nova.compute.manager [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Attaching volume cb101440-f092-4818-b8ef-1e2da8c26cfa to /dev/vdb
Apr 11 19:37:02 user nova-compute[82196]: DEBUG os_brick.utils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ba6e18-7950-47e2-b9ad-f2f263b56fe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2dd392-5191-4af4-a077-8d76ad996234]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feeec17-2483-47fb-a93d-923cd385b532]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3d5324-2829-45d9-8124-e38d1d80cdb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.network.neutron [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Updated VIF entry in instance network info cache for port 82ee2878-c477-419c-97ba-9ac4b36dacab. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.network.neutron [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Updating instance_info_cache with network_info: [{"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:37:03 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8219b93-5c4c-4c22-9fad-73c76007c43e]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.utils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Updating existing volume attachment record: d8ae7cfa-3c35-453f-8a70-00bc770ef4e3 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-224ece6b-d6e2-4a86-84fd-4449a1cf9cbc req-e63c0700-11ad-45b5-8150-e31be7126e15 service nova] Releasing lock "refresh_cache-8c45de50-92bc-467c-9f3d-7e667e1d0bb3" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCMWSIrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:03 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26439393334623039', 'path': '/dev/sdf'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439393334623039', 'path': '/dev/sdf'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.185s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:03 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:03 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef5003-a8ea-4430-a166-42df496ac65f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:37:03 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:36:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-783988854',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-783988854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-783988854',id=36,image_ref='24fc25bd-3ef8-478b-87dc-434d48415b06',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-f1he0ws0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-935343500',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:36:51Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=781f3398-3d54-49a4-a751-60f4fbc5e49a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb83845b-f94f-422d-9970-c00e62a4b142", "address": "fa:16:3e:68:ac:32", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb83845b-f9", "ovs_interfaceid": "eb83845b-f94f-422d-9970-c00e62a4b142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "eb83845b-f94f-422d-9970-c00e62a4b142", "address": "fa:16:3e:68:ac:32", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb83845b-f9", "ovs_interfaceid": "eb83845b-f94f-422d-9970-c00e62a4b142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:32,bridge_name='br-int',has_traffic_filtering=True,id=eb83845b-f94f-422d-9970-c00e62a4b142,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb83845b-f9') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.objects.instance [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lazy-loading 'pci_devices' on Instance uuid 781f3398-3d54-49a4-a751-60f4fbc5e49a {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:37:03 user nova-compute[82196]:   <uuid>781f3398-3d54-49a4-a751-60f4fbc5e49a</uuid>
Apr 11 19:37:03 user nova-compute[82196]:   <name>instance-00000024</name>
Apr 11 19:37:03 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:37:03 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:37:03 user nova-compute[82196]:   <metadata>
Apr 11 19:37:03 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:37:03 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:37:03 user nova-compute[82196]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-783988854</nova:name>
Apr 11 19:37:03 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:37:02</nova:creationTime>
Apr 11 19:37:03 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:37:03 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:37:03 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:37:03 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:37:03 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:37:03 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:37:03 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:37:03 user nova-compute[82196]:       <nova:owner>
Apr 11 19:37:03 user nova-compute[82196]:         <nova:user uuid="cf262cd03f4a41c4956d8784cf37d86d">tempest-TestVolumeBootPattern-935343500-project-member</nova:user>
Apr 11 19:37:03 user nova-compute[82196]:         <nova:project uuid="2caba0618fc743e7bfb2dd866a511df9">tempest-TestVolumeBootPattern-935343500</nova:project>
Apr 11 19:37:03 user nova-compute[82196]:       </nova:owner>
Apr 11 19:37:03 user nova-compute[82196]:       <nova:root type="image" uuid="24fc25bd-3ef8-478b-87dc-434d48415b06"/>
Apr 11 19:37:03 user nova-compute[82196]:       <nova:ports>
Apr 11 19:37:03 user nova-compute[82196]:         <nova:port uuid="eb83845b-f94f-422d-9970-c00e62a4b142">
Apr 11 19:37:03 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 19:37:03 user nova-compute[82196]:         </nova:port>
Apr 11 19:37:03 user nova-compute[82196]:       </nova:ports>
Apr 11 19:37:03 user nova-compute[82196]:     </nova:instance>
Apr 11 19:37:03 user nova-compute[82196]:   </metadata>
Apr 11 19:37:03 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:37:03 user nova-compute[82196]:     <system>
Apr 11 19:37:03 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:37:03 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:37:03 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:37:03 user nova-compute[82196]:       <entry name="serial">781f3398-3d54-49a4-a751-60f4fbc5e49a</entry>
Apr 11 19:37:03 user nova-compute[82196]:       <entry name="uuid">781f3398-3d54-49a4-a751-60f4fbc5e49a</entry>
Apr 11 19:37:03 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:37:03 user nova-compute[82196]:     </system>
Apr 11 19:37:03 user nova-compute[82196]:   </sysinfo>
Apr 11 19:37:03 user nova-compute[82196]:   <os>
Apr 11 19:37:03 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:37:03 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:37:03 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:37:03 user nova-compute[82196]:   </os>
Apr 11 19:37:03 user nova-compute[82196]:   <features>
Apr 11 19:37:03 user nova-compute[82196]:     <acpi/>
Apr 11 19:37:03 user nova-compute[82196]:     <apic/>
Apr 11 19:37:03 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:37:03 user nova-compute[82196]:   </features>
Apr 11 19:37:03 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:37:03 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:37:03 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:37:03 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:37:03 user nova-compute[82196]:   </clock>
Apr 11 19:37:03 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:37:03 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:37:03 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:37:03 user nova-compute[82196]:   </cpu>
Apr 11 19:37:03 user nova-compute[82196]:   <devices>
Apr 11 19:37:03 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:37:03 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:37:03 user nova-compute[82196]:       <source dev="/dev/sdf"/>
Apr 11 19:37:03 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:37:03 user nova-compute[82196]:       <serial>c9c5a627-5807-4f3d-8d02-d01cb358784b</serial>
Apr 11 19:37:03 user nova-compute[82196]:     </disk>
Apr 11 19:37:03 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:37:03 user nova-compute[82196]:       <mac address="fa:16:3e:68:ac:32"/>
Apr 11 19:37:03 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:37:03 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:37:03 user nova-compute[82196]:       <target dev="tapeb83845b-f9"/>
Apr 11 19:37:03 user nova-compute[82196]:     </interface>
Apr 11 19:37:03 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:37:03 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/781f3398-3d54-49a4-a751-60f4fbc5e49a/console.log" append="off"/>
Apr 11 19:37:03 user nova-compute[82196]:     </serial>
Apr 11 19:37:03 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:37:03 user nova-compute[82196]:     <video>
Apr 11 19:37:03 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:37:03 user nova-compute[82196]:     </video>
Apr 11 19:37:03 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:37:03 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:37:03 user nova-compute[82196]:     </rng>
Apr 11 19:37:03 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:37:03 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:37:03 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:37:03 user nova-compute[82196]:     </memballoon>
Apr 11 19:37:03 user nova-compute[82196]:   </devices>
Apr 11 19:37:03 user nova-compute[82196]: </domain>
Apr 11 19:37:03 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:36:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-783988854',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-783988854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-783988854',id=36,image_ref='24fc25bd-3ef8-478b-87dc-434d48415b06',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-f1he0ws0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-935343500',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:36:51Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=781f3398-3d54-49a4-a751-60f4fbc5e49a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb83845b-f94f-422d-9970-c00e62a4b142", "address": "fa:16:3e:68:ac:32", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb83845b-f9", "ovs_interfaceid": "eb83845b-f94f-422d-9970-c00e62a4b142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "eb83845b-f94f-422d-9970-c00e62a4b142", "address": "fa:16:3e:68:ac:32", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb83845b-f9", "ovs_interfaceid": "eb83845b-f94f-422d-9970-c00e62a4b142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:32,bridge_name='br-int',has_traffic_filtering=True,id=eb83845b-f94f-422d-9970-c00e62a4b142,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb83845b-f9') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_vif [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:32,bridge_name='br-int',has_traffic_filtering=True,id=eb83845b-f94f-422d-9970-c00e62a4b142,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb83845b-f9') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dd5a82-a086-4448-a42f-dd53cd2b6295]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38] added
Apr 11 19:37:03 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb83845b-f9, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb83845b-f9, col_values=(('external_ids', {'iface-id': 'eb83845b-f94f-422d-9970-c00e62a4b142', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:ac:32', 'vm-uuid': '781f3398-3d54-49a4-a751-60f4fbc5e49a'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:03 user nova-compute[82196]: INFO os_vif [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:32,bridge_name='br-int',has_traffic_filtering=True,id=eb83845b-f94f-422d-9970-c00e62a4b142,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb83845b-f9')
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e831a1f-373f-418f-bf71-98ef924f6f74]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[409d41c3-9933-4606-bf87-76f1db7ca4fa]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oCMWSIrD {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oCMWSIrD" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8337c29e-2f8e-4666-b71c-a53d58212fbf]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oCMWSIrD'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] No VIF found with MAC fa:16:3e:68:ac:32, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59b7f72-61c9-4d59-b79d-7fcbfb2134bc]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d892eb1f-2d94-45c5-8cd7-a147b646fc86]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:03 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:03 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:03 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:03 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:03 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:03 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:03 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:03 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:03 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:03 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --login" returned: 0 in 0.182s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[55da6e6c-4fed-4480-91dc-2dc8abf11871]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38, portal: 172.16.0.220,3260]
Apr 11 19:37:04 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38, portal: 172.16.0.220,3260] successful.
Apr 11 19:37:04 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.061s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63446e0-ce7b-47b1-8a4f-9c3807f0ed70]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d337e945-8aa6-4db3-85f0-9692a7f49ef5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:04 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:04 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:04 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:04 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:04 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:04 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:04 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:04 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:04 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:04 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:04 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:04 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.489s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[910d6c41-78fb-4f69-99d7-51aa0e6ad296]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCMWSIrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:37:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.526s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] <== connect_volume: return (1712ms) {'type': 'block', 'scsi_wwn': '26336616163623136', 'path': '/dev/sdg'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336616163623136', 'path': '/dev/sdg'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG nova.objects.instance [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'flavor' on Instance uuid 5d000531-5884-405d-9e17-1dc5f39226d0 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:37:05 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:37:05 user nova-compute[82196]:   <source dev="/dev/sdg"/>
Apr 11 19:37:05 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:37:05 user nova-compute[82196]:   <serial>2af66735-f8a4-4b22-83ed-fc2180654d38</serial>
Apr 11 19:37:05 user nova-compute[82196]: </disk>
Apr 11 19:37:05 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-34a3c057-1b4c-47bc-afcb-68816d0820c7 req-632ae860-8f38-41ac-9e5b-e1256541df21 service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Received event network-vif-plugged-eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-34a3c057-1b4c-47bc-afcb-68816d0820c7 req-632ae860-8f38-41ac-9e5b-e1256541df21 service nova] Acquiring lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-34a3c057-1b4c-47bc-afcb-68816d0820c7 req-632ae860-8f38-41ac-9e5b-e1256541df21 service nova] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-34a3c057-1b4c-47bc-afcb-68816d0820c7 req-632ae860-8f38-41ac-9e5b-e1256541df21 service nova] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-34a3c057-1b4c-47bc-afcb-68816d0820c7 req-632ae860-8f38-41ac-9e5b-e1256541df21 service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] No waiting events found dispatching network-vif-plugged-eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:05 user nova-compute[82196]: WARNING nova.compute.manager [req-34a3c057-1b4c-47bc-afcb-68816d0820c7 req-632ae860-8f38-41ac-9e5b-e1256541df21 service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Received unexpected event network-vif-plugged-eb83845b-f94f-422d-9970-c00e62a4b142 for instance with vm_state building and task_state spawning.
Apr 11 19:37:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] No VIF found with MAC fa:16:3e:7a:2b:e5, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:37:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7003a6b4-04d6-4ec6-ba6e-c1967c5f3bb5 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "5d000531-5884-405d-9e17-1dc5f39226d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.609s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG os_brick.utils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c30ec9a-c126-44c6-b70e-df006e902b7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6015cd4-c15e-43e9-a7f1-bcd1f5cedef5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c95facd-10fb-4a7f-a79d-82cb91f6f0bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[368956f1-8ea4-4c5e-834d-f97a8475eaac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:37:06 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:37:06 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdf41d4-c1fd-47d6-ad7d-1223064804d0]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG os_brick.utils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:06 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Updating existing volume attachment record: a3a4dc7b-edc5-47d1-8608-34ba6cd5b913 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.compute.manager [req-67c179b7-5729-4595-9cb0-3b1ff2099077 req-db3fb144-8229-47e0-bfc5-5292c5f4e866 service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Received event network-vif-plugged-eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-67c179b7-5729-4595-9cb0-3b1ff2099077 req-db3fb144-8229-47e0-bfc5-5292c5f4e866 service nova] Acquiring lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-67c179b7-5729-4595-9cb0-3b1ff2099077 req-db3fb144-8229-47e0-bfc5-5292c5f4e866 service nova] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-67c179b7-5729-4595-9cb0-3b1ff2099077 req-db3fb144-8229-47e0-bfc5-5292c5f4e866 service nova] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.compute.manager [req-67c179b7-5729-4595-9cb0-3b1ff2099077 req-db3fb144-8229-47e0-bfc5-5292c5f4e866 service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] No waiting events found dispatching network-vif-plugged-eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:07 user nova-compute[82196]: WARNING nova.compute.manager [req-67c179b7-5729-4595-9cb0-3b1ff2099077 req-db3fb144-8229-47e0-bfc5-5292c5f4e866 service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Received unexpected event network-vif-plugged-eb83845b-f94f-422d-9970-c00e62a4b142 for instance with vm_state building and task_state spawning.
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241827.625416, 781f3398-3d54-49a4-a751-60f4fbc5e49a => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:37:07 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] VM Resumed (Lifecycle Event)
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:37:07 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Instance spawned successfully.
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:37:07 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241827.6257596, 781f3398-3d54-49a4-a751-60f4fbc5e49a => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:37:07 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] VM Started (Lifecycle Event)
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:07 user nova-compute[82196]: INFO nova.compute.manager [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Took 5.50 seconds to spawn the instance on the hypervisor.
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:37:07 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:37:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSPbhzcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:07 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:07 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:07 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b225da32-4b19-4f82-9c77-ff32682ca64d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:37:07 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:07 user nova-compute[82196]: INFO nova.compute.manager [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Took 17.50 seconds to build instance.
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[04923b6b-d284-4b70-9b54-4fb1c7ba890e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa] added
Apr 11 19:37:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-dadf7f3d-9500-4c57-b083-3d044c789acd tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.603s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aff91a-e55b-45e0-b43c-18a04a3faef6]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9db5e3-60df-428e-9af5-5cb8d0bb7bd5]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSPbhzcg {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSPbhzcg" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[142f07db-f0cc-45af-8ee8-02798509ab91]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uSPbhzcg'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17a4b3b-62ca-4e3a-8232-1449cc50b409]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf04b4b-335e-40b6-81ca-26c40b9eaa11]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:07 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:07 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:07 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:07 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:07 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:07 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:07 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:07 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:07 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:07 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[baee0aeb-7a1c-43bc-b742-b68ff9e561de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa, portal: 172.16.0.220,3260]
Apr 11 19:37:08 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa, portal: 172.16.0.220,3260] successful.
Apr 11 19:37:08 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ee9b53-dc82-446e-a4e1-2ea65906ab20]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bddea87-0131-47c3-93d9-142fae10953f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:08 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:08 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:08 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:08 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:08 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:08 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:08 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:08 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:08 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:08 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:08 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:08 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:08 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:08 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] HCTL ('39', '-', '-', 0) found on session 36 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bac107-e23f-4380-8c9b-a99e0dfea768]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Searching for a device in session 36 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSPbhzcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:37:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:09 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:09 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26232613431613061', 'path': '/dev/sdh'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232613431613061', 'path': '/dev/sdh'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:37:09 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:37:09 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:37:09 user nova-compute[82196]:   <source dev="/dev/sdh"/>
Apr 11 19:37:09 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:37:09 user nova-compute[82196]:   <serial>cb101440-f092-4818-b8ef-1e2da8c26cfa</serial>
Apr 11 19:37:09 user nova-compute[82196]: </disk>
Apr 11 19:37:09 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:37:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:37:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:37:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No VIF found with MAC fa:16:3e:0c:56:f8, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:37:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a8fcba03-4178-4eff-978d-71bcf69ba87d tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.966s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:37:11 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Creating image(s)
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Ensure instance console log exists: /opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Start _get_guest_xml network_info=[{"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIifBHeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c45de50-92bc-467c-9f3d-7e667e1d0bb3', 'attached_at': '', 'detached_at': '', 'volume_id': 'e13194fc-7f97-44b9-afa8-9380e7358af8', 'serial': 'e13194fc-7f97-44b9-afa8-9380e7358af8'}, 'attachment_id': 'a3a4dc7b-edc5-47d1-8608-34ba6cd5b913', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:37:11 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:37:11 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIifBHeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:11 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:11 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:11 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e79441c-81ff-4e19-8386-bd822e1f7f6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:37:11 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ccf80c-62a5-466e-8e79-52ef288d4be0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8] added
Apr 11 19:37:11 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[055aca85-c967-447c-80c8-298864417983]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e231ed5-aa6f-4af5-b4a3-045cc90cbab8]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIifBHeC {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIifBHeC" returned: 0 in 0.030s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e167cfe6-5816-4465-8238-5ce41ab260ba]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dIifBHeC'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5a5209-d010-4821-b0fa-5302ae820720]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ebaa26-f9d5-4342-99d1-d509a4c0d7f8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:11 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:11 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ea0584-5278-4ef8-be84-df6acbb7fcd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8, portal: 172.16.0.220,3260]
Apr 11 19:37:11 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8, portal: 172.16.0.220,3260] successful.
Apr 11 19:37:11 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c780b83e-e27a-4c82-98ea-148f9fdfaf7d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f927b5-f897-47f7-a043-7a1154ccd548]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:11 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:11 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] HCTL ('40', '-', '-', 0) found on session 37 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8396bca-c760-4dc6-b147-fb0e93ddfbd0]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Searching for a device in session 37 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:37:11 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIifBHeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG nova.objects.instance [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:12 user nova-compute[82196]: INFO nova.compute.manager [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Attaching volume fe7d53f9-3e55-493f-937b-b8bb59c63939 to /dev/vdc
Apr 11 19:37:12 user nova-compute[82196]: DEBUG os_brick.utils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffc98db-5c9f-4825-b4df-789b05c62137]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1912bb6-1891-4b6d-be1e-ff1be9c71fce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[03221041-2986-4dbc-987c-0af5ac15e949]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[00608312-0402-498f-bfe9-3fa05471d8ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:37:12 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:37:12 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3473bd2f-d16c-407f-844d-f1f6ef2741be]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG os_brick.utils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Updating existing volume attachment record: 3d7a6519-ef43-4af0-81b1-5e6913e066f6 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23733643532346666', 'path': '/dev/sdi'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733643532346666', 'path': '/dev/sdi'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2051818305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2051818305',id=37,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-uoeaatrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:37:00Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=8c45de50-92bc-467c-9f3d-7e667e1d0bb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:09:60,bridge_name='br-int',has_traffic_filtering=True,id=82ee2878-c477-419c-97ba-9ac4b36dacab,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ee2878-c4') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG nova.objects.instance [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:37:12 user nova-compute[82196]:   <uuid>8c45de50-92bc-467c-9f3d-7e667e1d0bb3</uuid>
Apr 11 19:37:12 user nova-compute[82196]:   <name>instance-00000025</name>
Apr 11 19:37:12 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:37:12 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:37:12 user nova-compute[82196]:   <metadata>
Apr 11 19:37:12 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:37:12 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:37:12 user nova-compute[82196]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2051818305</nova:name>
Apr 11 19:37:12 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:37:11</nova:creationTime>
Apr 11 19:37:12 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:37:12 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:37:12 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:37:12 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:37:12 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:37:12 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:37:12 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:37:12 user nova-compute[82196]:       <nova:owner>
Apr 11 19:37:12 user nova-compute[82196]:         <nova:user uuid="1b3adca432b04d70818a51d1366f5c6d">tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member</nova:user>
Apr 11 19:37:12 user nova-compute[82196]:         <nova:project uuid="eb91586feb3f4a4c84fa8c2183baaf8c">tempest-ServerBootFromVolumeStableRescueTest-863156619</nova:project>
Apr 11 19:37:12 user nova-compute[82196]:       </nova:owner>
Apr 11 19:37:12 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:37:12 user nova-compute[82196]:       <nova:ports>
Apr 11 19:37:12 user nova-compute[82196]:         <nova:port uuid="82ee2878-c477-419c-97ba-9ac4b36dacab">
Apr 11 19:37:12 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 19:37:12 user nova-compute[82196]:         </nova:port>
Apr 11 19:37:12 user nova-compute[82196]:       </nova:ports>
Apr 11 19:37:12 user nova-compute[82196]:     </nova:instance>
Apr 11 19:37:12 user nova-compute[82196]:   </metadata>
Apr 11 19:37:12 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:37:12 user nova-compute[82196]:     <system>
Apr 11 19:37:12 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:37:12 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:37:12 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:37:12 user nova-compute[82196]:       <entry name="serial">8c45de50-92bc-467c-9f3d-7e667e1d0bb3</entry>
Apr 11 19:37:12 user nova-compute[82196]:       <entry name="uuid">8c45de50-92bc-467c-9f3d-7e667e1d0bb3</entry>
Apr 11 19:37:12 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:37:12 user nova-compute[82196]:     </system>
Apr 11 19:37:12 user nova-compute[82196]:   </sysinfo>
Apr 11 19:37:12 user nova-compute[82196]:   <os>
Apr 11 19:37:12 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:37:12 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:37:12 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:37:12 user nova-compute[82196]:   </os>
Apr 11 19:37:12 user nova-compute[82196]:   <features>
Apr 11 19:37:12 user nova-compute[82196]:     <acpi/>
Apr 11 19:37:12 user nova-compute[82196]:     <apic/>
Apr 11 19:37:12 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:37:12 user nova-compute[82196]:   </features>
Apr 11 19:37:12 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:37:12 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:37:12 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:37:12 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:37:12 user nova-compute[82196]:   </clock>
Apr 11 19:37:12 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:37:12 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:37:12 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:37:12 user nova-compute[82196]:   </cpu>
Apr 11 19:37:12 user nova-compute[82196]:   <devices>
Apr 11 19:37:12 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:37:12 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:37:12 user nova-compute[82196]:       <source dev="/dev/sdi"/>
Apr 11 19:37:12 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:37:12 user nova-compute[82196]:       <serial>e13194fc-7f97-44b9-afa8-9380e7358af8</serial>
Apr 11 19:37:12 user nova-compute[82196]:     </disk>
Apr 11 19:37:12 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:37:12 user nova-compute[82196]:       <mac address="fa:16:3e:27:09:60"/>
Apr 11 19:37:12 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:37:12 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:37:12 user nova-compute[82196]:       <target dev="tap82ee2878-c4"/>
Apr 11 19:37:12 user nova-compute[82196]:     </interface>
Apr 11 19:37:12 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:37:12 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/console.log" append="off"/>
Apr 11 19:37:12 user nova-compute[82196]:     </serial>
Apr 11 19:37:12 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:37:12 user nova-compute[82196]:     <video>
Apr 11 19:37:12 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:37:12 user nova-compute[82196]:     </video>
Apr 11 19:37:12 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:37:12 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:37:12 user nova-compute[82196]:     </rng>
Apr 11 19:37:12 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:37:12 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:37:12 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:37:12 user nova-compute[82196]:     </memballoon>
Apr 11 19:37:12 user nova-compute[82196]:   </devices>
Apr 11 19:37:12 user nova-compute[82196]: </domain>
Apr 11 19:37:12 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2051818305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2051818305',id=37,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-uoeaatrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:37:00Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=8c45de50-92bc-467c-9f3d-7e667e1d0bb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:09:60,bridge_name='br-int',has_traffic_filtering=True,id=82ee2878-c477-419c-97ba-9ac4b36dacab,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ee2878-c4') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG os_vif [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:09:60,bridge_name='br-int',has_traffic_filtering=True,id=82ee2878-c477-419c-97ba-9ac4b36dacab,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ee2878-c4') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82ee2878-c4, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82ee2878-c4, col_values=(('external_ids', {'iface-id': '82ee2878-c477-419c-97ba-9ac4b36dacab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:09:60', 'vm-uuid': '8c45de50-92bc-467c-9f3d-7e667e1d0bb3'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:13 user nova-compute[82196]: INFO os_vif [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:09:60,bridge_name='br-int',has_traffic_filtering=True,id=82ee2878-c477-419c-97ba-9ac4b36dacab,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ee2878-c4')
Apr 11 19:37:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:37:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No VIF found with MAC fa:16:3e:27:09:60, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:37:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-3edf95c9-8f83-49c5-8198-171d040e8546 req-afbc0929-0d1d-42d2-aad8-a790a40dcf46 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3edf95c9-8f83-49c5-8198-171d040e8546 req-afbc0929-0d1d-42d2-aad8-a790a40dcf46 service nova] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3edf95c9-8f83-49c5-8198-171d040e8546 req-afbc0929-0d1d-42d2-aad8-a790a40dcf46 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3edf95c9-8f83-49c5-8198-171d040e8546 req-afbc0929-0d1d-42d2-aad8-a790a40dcf46 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-3edf95c9-8f83-49c5-8198-171d040e8546 req-afbc0929-0d1d-42d2-aad8-a790a40dcf46 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] No waiting events found dispatching network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:14 user nova-compute[82196]: WARNING nova.compute.manager [req-3edf95c9-8f83-49c5-8198-171d040e8546 req-afbc0929-0d1d-42d2-aad8-a790a40dcf46 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received unexpected event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab for instance with vm_state building and task_state spawning.
Apr 11 19:37:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241836.5093067, 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:37:16 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] VM Resumed (Lifecycle Event)
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:37:16 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Instance spawned successfully.
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:37:16 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241836.5129468, 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:37:16 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] VM Started (Lifecycle Event)
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:37:16 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:37:16 user nova-compute[82196]: INFO nova.compute.manager [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Took 5.30 seconds to spawn the instance on the hypervisor.
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.compute.manager [req-30f81514-8b83-40b3-aa33-39cb3a5f064b req-3b67193a-b48c-473f-bc41-b87476acd1f3 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-30f81514-8b83-40b3-aa33-39cb3a5f064b req-3b67193a-b48c-473f-bc41-b87476acd1f3 service nova] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-30f81514-8b83-40b3-aa33-39cb3a5f064b req-3b67193a-b48c-473f-bc41-b87476acd1f3 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-30f81514-8b83-40b3-aa33-39cb3a5f064b req-3b67193a-b48c-473f-bc41-b87476acd1f3 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:16 user nova-compute[82196]: DEBUG nova.compute.manager [req-30f81514-8b83-40b3-aa33-39cb3a5f064b req-3b67193a-b48c-473f-bc41-b87476acd1f3 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] No waiting events found dispatching network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:16 user nova-compute[82196]: WARNING nova.compute.manager [req-30f81514-8b83-40b3-aa33-39cb3a5f064b req-3b67193a-b48c-473f-bc41-b87476acd1f3 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received unexpected event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab for instance with vm_state building and task_state spawning.
Apr 11 19:37:16 user nova-compute[82196]: INFO nova.compute.manager [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Took 17.24 seconds to build instance.
Apr 11 19:37:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f19b3d4c-453d-4471-90bf-19c983e4e608 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.334s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXMwQRmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:17 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:17 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:17 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28c5267-3ec9-4ae3-9cfc-a49a68d180d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:37:17 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f57866f-8633-4034-bcab-d62ff4b44783]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939] added
Apr 11 19:37:17 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d3aa24-5cb4-48f3-8f8a-cee4b9d46d9d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59f6927-7f85-4996-93aa-2a0fac4c45f4]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXMwQRmz {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXMwQRmz" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[343ad6bb-5ed7-4613-be6d-d4a2d6820237]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DXMwQRmz'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b062f0d-e8a6-41cd-b589-7961450d9b81]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d809a337-22c2-4342-9f39-bdaeedadd633]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c33544-6775-4b97-92eb-f3caeaff0ec7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939, portal: 172.16.0.220,3260]
Apr 11 19:37:17 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939, portal: 172.16.0.220,3260] successful.
Apr 11 19:37:17 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3760ff12-5a80-401e-b1f2-d80405c0870f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9b2a5d-3801-4029-91fb-b9294dd2242b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)
Apr 11 19:37:17 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] HCTL ('41', '-', '-', 0) found on session 38 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d20d6be-bf39-47b0-90d0-9509ca6b218d]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Searching for a device in session 38 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:37:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXMwQRmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:37:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23362313834343861', 'path': '/dev/sdj'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362313834343861', 'path': '/dev/sdj'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:37:18 user nova-compute[82196]: DEBUG nova.objects.instance [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:37:18 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:37:18 user nova-compute[82196]:   <source dev="/dev/sdj"/>
Apr 11 19:37:18 user nova-compute[82196]:   <target dev="vdc" bus="virtio"/>
Apr 11 19:37:18 user nova-compute[82196]:   <serial>fe7d53f9-3e55-493f-937b-b8bb59c63939</serial>
Apr 11 19:37:18 user nova-compute[82196]: </disk>
Apr 11 19:37:18 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:37:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "5d000531-5884-405d-9e17-1dc5f39226d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "5d000531-5884-405d-9e17-1dc5f39226d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:18 user nova-compute[82196]: INFO nova.compute.manager [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Detaching volume 2af66735-f8a4-4b22-83ed-fc2180654d38
Apr 11 19:37:18 user nova-compute[82196]: INFO nova.virt.block_device [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Attempting to driver detach volume 2af66735-f8a4-4b22-83ed-fc2180654d38 from mountpoint /dev/vdb
Apr 11 19:37:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Attempting to detach device vdb from instance 5d000531-5884-405d-9e17-1dc5f39226d0 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:37:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:37:18 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:37:18 user nova-compute[82196]:   <source dev="/dev/sdg"/>
Apr 11 19:37:18 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:37:18 user nova-compute[82196]:   <serial>2af66735-f8a4-4b22-83ed-fc2180654d38</serial>
Apr 11 19:37:18 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:37:18 user nova-compute[82196]: </disk>
Apr 11 19:37:18 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:37:18 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Successfully detached device vdb from instance 5d000531-5884-405d-9e17-1dc5f39226d0 from the persistent domain config.
Apr 11 19:37:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d000531-5884-405d-9e17-1dc5f39226d0 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:37:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:37:18 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:37:18 user nova-compute[82196]:   <source dev="/dev/sdg"/>
Apr 11 19:37:18 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:37:18 user nova-compute[82196]:   <serial>2af66735-f8a4-4b22-83ed-fc2180654d38</serial>
Apr 11 19:37:18 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:37:18 user nova-compute[82196]: </disk>
Apr 11 19:37:18 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:37:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "5d000531-5884-405d-9e17-1dc5f39226d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] No VIF found with MAC fa:16:3e:0c:56:f8, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bd441262-8ff7-405c-b75b-5a7da5f1f22a tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.809s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241839.3046627, 5d000531-5884-405d-9e17-1dc5f39226d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d000531-5884-405d-9e17-1dc5f39226d0 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:37:19 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Successfully detached device vdb from instance 5d000531-5884-405d-9e17-1dc5f39226d0 from the live domain config.
Apr 11 19:37:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCMWSIrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:19 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[27000465-6b56-4dcc-8177-6e81b2514125]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:37:19 user nova-compute[82196]: No targets found.
Apr 11 19:37:19 user nova-compute[82196]: iSNS:
Apr 11 19:37:19 user nova-compute[82196]: No targets found.
Apr 11 19:37:19 user nova-compute[82196]: STATIC:
Apr 11 19:37:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574
Apr 11 19:37:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:37:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38
Apr 11 19:37:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa
Apr 11 19:37:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:37:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939
Apr 11 19:37:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e
Apr 11 19:37:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418
Apr 11 19:37:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:19 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b
Apr 11 19:37:19 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:19 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:19 user nova-compute[82196]: FIRMWARE:
Apr 11 19:37:19 user nova-compute[82196]: No targets found.
Apr 11 19:37:19 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:37:19 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:37:19 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e0aa00-561f-48c8-abf1-b2b3862525bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f0f2f6-5141-4974-9d1d-dbf625434467]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)
Apr 11 19:37:19 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:19 user nova-compute[82196]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)
Apr 11 19:37:19 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92741801f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38'): ({'sdg'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Removing single pathed devices sdg {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[388bda4a-43b2-48b4-a74a-c810a2ae6052]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5bb1b5-b8a7-438d-89d6-bf0d61383b68]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Flushing IO for device /dev/sdg {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[de38a502-9982-4a28-aabe-dbf9d54d510e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65c065a-0da2-4554-924e-211aab73df56]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] SCSI volumes sdg have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6b0c49-390d-4b78-a231-23cfb7e5311f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d312a6-73aa-45cd-94dd-c7a02526d803]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38, portal: 172.16.0.220,3260]
Apr 11 19:37:19 user nova-compute[82196]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38, portal: 172.16.0.220,3260] successful.
Apr 11 19:37:19 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c44c12-57b6-46b1-8e73-b67081d1230b]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] <== disconnect_volume: return (378ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:37:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:20 user nova-compute[82196]: INFO nova.compute.manager [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Detaching volume cb101440-f092-4818-b8ef-1e2da8c26cfa
Apr 11 19:37:20 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'flavor' on Instance uuid 5d000531-5884-405d-9e17-1dc5f39226d0 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:20 user nova-compute[82196]: INFO nova.virt.block_device [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Attempting to driver detach volume cb101440-f092-4818-b8ef-1e2da8c26cfa from mountpoint /dev/vdb
Apr 11 19:37:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Attempting to detach device vdb from instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:37:20 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:37:20 user nova-compute[82196]:   <source dev="/dev/sdh"/>
Apr 11 19:37:20 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:37:20 user nova-compute[82196]:   <serial>cb101440-f092-4818-b8ef-1e2da8c26cfa</serial>
Apr 11 19:37:20 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:37:20 user nova-compute[82196]: </disk>
Apr 11 19:37:20 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:37:20 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully detached device vdb from instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 from the persistent domain config.
Apr 11 19:37:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:37:20 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:37:20 user nova-compute[82196]:   <source dev="/dev/sdh"/>
Apr 11 19:37:20 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:37:20 user nova-compute[82196]:   <serial>cb101440-f092-4818-b8ef-1e2da8c26cfa</serial>
Apr 11 19:37:20 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:37:20 user nova-compute[82196]: </disk>
Apr 11 19:37:20 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b185af67-f8d1-4011-bcc9-1db324631473 tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "5d000531-5884-405d-9e17-1dc5f39226d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.856s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "5d000531-5884-405d-9e17-1dc5f39226d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.719s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:20 user nova-compute[82196]: INFO nova.compute.manager [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Terminating instance
Apr 11 19:37:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-602017ff-bc12-4525-b739-c28552d0ebb0 req-725c113e-3a69-4723-80fd-3d50bcca0407 service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Received event network-vif-unplugged-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-602017ff-bc12-4525-b739-c28552d0ebb0 req-725c113e-3a69-4723-80fd-3d50bcca0407 service nova] Acquiring lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-602017ff-bc12-4525-b739-c28552d0ebb0 req-725c113e-3a69-4723-80fd-3d50bcca0407 service nova] Lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-602017ff-bc12-4525-b739-c28552d0ebb0 req-725c113e-3a69-4723-80fd-3d50bcca0407 service nova] Lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-602017ff-bc12-4525-b739-c28552d0ebb0 req-725c113e-3a69-4723-80fd-3d50bcca0407 service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] No waiting events found dispatching network-vif-unplugged-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-602017ff-bc12-4525-b739-c28552d0ebb0 req-725c113e-3a69-4723-80fd-3d50bcca0407 service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Received event network-vif-unplugged-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241841.0346217, bd559e67-3c8f-42b4-b1d6-fd171c8850b8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:37:21 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully detached device vdb from instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 from the live domain config.
Apr 11 19:37:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSPbhzcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:21 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ff5bbb-0522-4002-9b79-c3422e828d56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:37:21 user nova-compute[82196]: No targets found.
Apr 11 19:37:21 user nova-compute[82196]: iSNS:
Apr 11 19:37:21 user nova-compute[82196]: No targets found.
Apr 11 19:37:21 user nova-compute[82196]: STATIC:
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: FIRMWARE:
Apr 11 19:37:21 user nova-compute[82196]: No targets found.
Apr 11 19:37:21 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:37:21 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:37:21 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb112cfd-bdc4-4bbb-a2e6-d74ea0e4fc6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e203e83-1f22-4b42-8005-bbda9cdb579f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92404391b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa'): ({'sdh'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Removing single pathed devices sdh {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d965eb-c5f8-4c69-9350-dc597e6c8f5d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb69929-c9cb-4351-9781-023218364a8e]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flushing IO for device /dev/sdh {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[721d2977-5555-42d7-83c8-c8b7bb8914c5]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1e9a1e-8fa5-4a16-a5bc-96c20b1fe4c4]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] SCSI volumes sdh have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd57b2e-4b9b-4fb9-a22c-52ee86ff887b]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9ac06d-3206-4fa9-9065-4a2ef235f233]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa, portal: 172.16.0.220,3260]
Apr 11 19:37:21 user nova-compute[82196]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa, portal: 172.16.0.220,3260] successful.
Apr 11 19:37:21 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb101440-f092-4818-b8ef-1e2da8c26cfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7d2354-8847-4ed4-b993-419bc1603ced]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] <== disconnect_volume: return (360ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:37:21 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Instance destroyed successfully.
Apr 11 19:37:21 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lazy-loading 'resources' on Instance uuid 5d000531-5884-405d-9e17-1dc5f39226d0 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-90407416',display_name='tempest-VolumesSnapshotTestJSON-instance-90407416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-90407416',id=33,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:35:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d5246cf04a7401388cba38d16e298ae',ramdisk_id='',reservation_id='r-4k8706hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-111705993',owner_user_name='tempest-VolumesSnapshotTestJSON-111705993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:35:15Z,user_data=None,user_id='20f337feb0ed4653976ace530bfdd877',uuid=5d000531-5884-405d-9e17-1dc5f39226d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "address": "fa:16:3e:7a:2b:e5", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff284fa-eb", "ovs_interfaceid": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Converting VIF {"id": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "address": "fa:16:3e:7a:2b:e5", "network": {"id": "18af527e-3475-4ab6-a415-0076cb1766db", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1102181865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6d5246cf04a7401388cba38d16e298ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff284fa-eb", "ovs_interfaceid": "0ff284fa-ebe1-4fe5-9942-7d57a7bb641a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2b:e5,bridge_name='br-int',has_traffic_filtering=True,id=0ff284fa-ebe1-4fe5-9942-7d57a7bb641a,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ff284fa-eb') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_vif [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2b:e5,bridge_name='br-int',has_traffic_filtering=True,id=0ff284fa-ebe1-4fe5-9942-7d57a7bb641a,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ff284fa-eb') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ff284fa-eb, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:21 user nova-compute[82196]: INFO os_vif [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2b:e5,bridge_name='br-int',has_traffic_filtering=True,id=0ff284fa-ebe1-4fe5-9942-7d57a7bb641a,network=Network(18af527e-3475-4ab6-a415-0076cb1766db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ff284fa-eb')
Apr 11 19:37:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCMWSIrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:21 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[769ad93d-bfee-4b5d-8639-f2a331da17e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:37:21 user nova-compute[82196]: No targets found.
Apr 11 19:37:21 user nova-compute[82196]: iSNS:
Apr 11 19:37:21 user nova-compute[82196]: No targets found.
Apr 11 19:37:21 user nova-compute[82196]: STATIC:
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b
Apr 11 19:37:21 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:21 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:21 user nova-compute[82196]: FIRMWARE:
Apr 11 19:37:21 user nova-compute[82196]: No targets found.
Apr 11 19:37:21 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:37:21 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:37:21 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2af66735-f8a4-4b22-83ed-fc2180654d38', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[428c8f43-07e6-4662-b9b3-8aa8c95c8a39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda28b41-73fb-4b86-a42e-1b2037bd568e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)
Apr 11 19:37:21 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f926414c4c0>, {}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Disconnecting from: [] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] <== disconnect_volume: return (94ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:37:21 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Deleting instance files /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0_del
Apr 11 19:37:21 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Deletion of /opt/stack/data/nova/instances/5d000531-5884-405d-9e17-1dc5f39226d0_del complete
Apr 11 19:37:21 user nova-compute[82196]: INFO nova.compute.manager [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Took 1.07 seconds to destroy the instance on the hypervisor.
Apr 11 19:37:21 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:37:21 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:37:22 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:37:22 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Took 0.53 seconds to deallocate network for instance.
Apr 11 19:37:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-e43106ab-26c3-434f-a1a0-7de06a74c985 req-4d70123e-dc01-425f-94bf-cf7981943704 service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Received event network-vif-deleted-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:22 user nova-compute[82196]: WARNING nova.volume.cinder [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Attachment 06b7556b-453e-488a-87e4-cf7d09c75c6b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 06b7556b-453e-488a-87e4-cf7d09c75c6b. (HTTP 404) (Request-ID: req-d7fce602-a684-4b82-8e70-7be33f0f6490)
Apr 11 19:37:22 user nova-compute[82196]: INFO nova.compute.manager [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Took 0.05 seconds to detach 1 volumes for instance.
Apr 11 19:37:22 user nova-compute[82196]: DEBUG nova.objects.instance [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0b2668a8-2b98-4881-8c78-2c77522cc4a0 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.909s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:22 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:37:22 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:37:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:22 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Deleted allocations for instance 5d000531-5884-405d-9e17-1dc5f39226d0
Apr 11 19:37:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:23 user nova-compute[82196]: INFO nova.compute.manager [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Detaching volume fe7d53f9-3e55-493f-937b-b8bb59c63939
Apr 11 19:37:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-629de017-aa49-4b17-b417-b7d02912a8ce req-fca98d39-4e53-46dd-8395-cf9439f9f00e service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Received event network-vif-plugged-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-629de017-aa49-4b17-b417-b7d02912a8ce req-fca98d39-4e53-46dd-8395-cf9439f9f00e service nova] Acquiring lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-629de017-aa49-4b17-b417-b7d02912a8ce req-fca98d39-4e53-46dd-8395-cf9439f9f00e service nova] Lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-629de017-aa49-4b17-b417-b7d02912a8ce req-fca98d39-4e53-46dd-8395-cf9439f9f00e service nova] Lock "5d000531-5884-405d-9e17-1dc5f39226d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-629de017-aa49-4b17-b417-b7d02912a8ce req-fca98d39-4e53-46dd-8395-cf9439f9f00e service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] No waiting events found dispatching network-vif-plugged-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:23 user nova-compute[82196]: WARNING nova.compute.manager [req-629de017-aa49-4b17-b417-b7d02912a8ce req-fca98d39-4e53-46dd-8395-cf9439f9f00e service nova] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Received unexpected event network-vif-plugged-0ff284fa-ebe1-4fe5-9942-7d57a7bb641a for instance with vm_state deleted and task_state None.
Apr 11 19:37:23 user nova-compute[82196]: INFO nova.virt.block_device [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Attempting to driver detach volume fe7d53f9-3e55-493f-937b-b8bb59c63939 from mountpoint /dev/vdc
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8d705088-6ab9-42b3-a1d0-20157a0dff1c tempest-VolumesSnapshotTestJSON-111705993 tempest-VolumesSnapshotTestJSON-111705993-project-member] Lock "5d000531-5884-405d-9e17-1dc5f39226d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.523s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Attempting to detach device vdc from instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:37:23 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:37:23 user nova-compute[82196]:   <source dev="/dev/sdj"/>
Apr 11 19:37:23 user nova-compute[82196]:   <target dev="vdc" bus="virtio"/>
Apr 11 19:37:23 user nova-compute[82196]:   <serial>fe7d53f9-3e55-493f-937b-b8bb59c63939</serial>
Apr 11 19:37:23 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 19:37:23 user nova-compute[82196]: </disk>
Apr 11 19:37:23 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:37:23 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully detached device vdc from instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 from the persistent domain config.
Apr 11 19:37:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:37:23 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:37:23 user nova-compute[82196]:   <source dev="/dev/sdj"/>
Apr 11 19:37:23 user nova-compute[82196]:   <target dev="vdc" bus="virtio"/>
Apr 11 19:37:23 user nova-compute[82196]:   <serial>fe7d53f9-3e55-493f-937b-b8bb59c63939</serial>
Apr 11 19:37:23 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 19:37:23 user nova-compute[82196]: </disk>
Apr 11 19:37:23 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681241843.528459, bd559e67-3c8f-42b4-b1d6-fd171c8850b8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:37:23 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully detached device vdc from instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8 from the live domain config.
Apr 11 19:37:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXMwQRmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:23 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da320b0-a5c8-4734-a943-820ec2a3f58f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:37:23 user nova-compute[82196]: No targets found.
Apr 11 19:37:23 user nova-compute[82196]: iSNS:
Apr 11 19:37:23 user nova-compute[82196]: No targets found.
Apr 11 19:37:23 user nova-compute[82196]: STATIC:
Apr 11 19:37:23 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574
Apr 11 19:37:23 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:23 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:23 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:37:23 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:23 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:23 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:37:23 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:23 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:23 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939
Apr 11 19:37:23 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:23 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:23 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e
Apr 11 19:37:23 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:23 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:23 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418
Apr 11 19:37:23 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:23 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:23 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b
Apr 11 19:37:23 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:23 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:23 user nova-compute[82196]: FIRMWARE:
Apr 11 19:37:23 user nova-compute[82196]: No targets found.
Apr 11 19:37:23 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:37:23 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:37:23 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cb09cb-fa0a-4fcf-ba36-61a3b43d6669]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc7def4-c1b6-4e02-ad53-7d7b9e0c5dec]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:23 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:23 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:23 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:23 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:23 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:23 user nova-compute[82196]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)
Apr 11 19:37:23 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:23 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:23 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:23 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:23 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:23 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:23 user nova-compute[82196]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 (non-flash)
Apr 11 19:37:23 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f924043a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939'): ({'sdj'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Removing single pathed devices sdj {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36e19bd-fb81-4092-8f2d-4d1ecdfba846]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d0146b-7249-43a1-9b00-6894ec93c98d]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Flushing IO for device /dev/sdj {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[82200716-ae8d-4152-a64c-6f7146cb2197]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.051s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[231d15b7-2bb6-43e5-867b-42f56eadae1c]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] SCSI volumes sdj have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d32aa91-a174-414a-a220-77d8fe43e8ec]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1207e204-d421-443c-8008-ae6f3bac3619]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939, portal: 172.16.0.220,3260]
Apr 11 19:37:23 user nova-compute[82196]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939, portal: 172.16.0.220,3260] successful.
Apr 11 19:37:23 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe7d53f9-3e55-493f-937b-b8bb59c63939 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[24328a42-4463-4e4a-a632-6f338f9fe570]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] <== disconnect_volume: return (375ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:37:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG nova.objects.instance [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'flavor' on Instance uuid bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f1f4821f-8e9a-4a1e-a311-2b9344130580 tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.082s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Port e4e4888a-168a-4fe8-a43e-ee683b50a39a binding to destination host user is already ACTIVE {{(pid=82196) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquired lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:25 user nova-compute[82196]: INFO nova.compute.manager [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Terminating instance
Apr 11 19:37:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-082b255a-a16d-45fb-b76b-2e66fa237ec1 req-3ad56e60-fd4b-40cc-9ab8-64b1e14eb5a6 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Received event network-vif-unplugged-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-082b255a-a16d-45fb-b76b-2e66fa237ec1 req-3ad56e60-fd4b-40cc-9ab8-64b1e14eb5a6 service nova] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-082b255a-a16d-45fb-b76b-2e66fa237ec1 req-3ad56e60-fd4b-40cc-9ab8-64b1e14eb5a6 service nova] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-082b255a-a16d-45fb-b76b-2e66fa237ec1 req-3ad56e60-fd4b-40cc-9ab8-64b1e14eb5a6 service nova] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-082b255a-a16d-45fb-b76b-2e66fa237ec1 req-3ad56e60-fd4b-40cc-9ab8-64b1e14eb5a6 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] No waiting events found dispatching network-vif-unplugged-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-082b255a-a16d-45fb-b76b-2e66fa237ec1 req-3ad56e60-fd4b-40cc-9ab8-64b1e14eb5a6 service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Received event network-vif-unplugged-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating instance_info_cache with network_info: [{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Releasing lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Creating tmpfile /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/tmpyfrqfsm0 to verify with other compute node that the instance is on the same shared storage. {{(pid=82196) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:26 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Instance destroyed successfully.
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.objects.instance [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lazy-loading 'resources' on Instance uuid bd559e67-3c8f-42b4-b1d6-fd171c8850b8 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:35:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-239003632',display_name='tempest-AttachVolumeTestJSON-server-239003632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-239003632',id=34,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj5U4wRknz1MMM6VxHMYJlHXKjuSjf0vHEAMH6+Udiac3pru4iQbtKDLsL6uIMSU8FT7pn+fHTrDxPsnf9BfAtyaZLT+gR1T3aHFQYwoKhwFOr64bBxhyIiMbG8SlmhFw==',key_name='tempest-keypair-1741457082',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:35:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d886d2ec5fc946b49af3c8ca7c8556c7',ramdisk_id='',reservation_id='r-02cds3yg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2144032498',owner_user_name='tempest-AttachVolumeTestJSON-2144032498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31c237e142784bd6aa460d6f1bf33400',uuid=bd559e67-3c8f-42b4-b1d6-fd171c8850b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "address": "fa:16:3e:0c:56:f8", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9fd5c5-52", "ovs_interfaceid": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converting VIF {"id": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "address": "fa:16:3e:0c:56:f8", "network": {"id": "5e65a1b0-a59c-43dd-abed-4aa020abdf5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1981108218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d886d2ec5fc946b49af3c8ca7c8556c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9fd5c5-52", "ovs_interfaceid": "ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:56:f8,bridge_name='br-int',has_traffic_filtering=True,id=ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9fd5c5-52') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG os_vif [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:56:f8,bridge_name='br-int',has_traffic_filtering=True,id=ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9fd5c5-52') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped9fd5c5-52, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:26 user nova-compute[82196]: INFO os_vif [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:56:f8,bridge_name='br-int',has_traffic_filtering=True,id=ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2,network=Network(5e65a1b0-a59c-43dd-abed-4aa020abdf5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9fd5c5-52')
Apr 11 19:37:26 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Deleting instance files /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8_del
Apr 11 19:37:26 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Deletion of /opt/stack/data/nova/instances/bd559e67-3c8f-42b4-b1d6-fd171c8850b8_del complete
Apr 11 19:37:26 user nova-compute[82196]: INFO nova.compute.manager [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 19:37:26 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:37:26 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance destroyed successfully.
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'resources' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-505347267',display_name='tempest-ServerActionsTestJSON-server-1599172202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-505347267',id=21,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-lxpjy0l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:35:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=647674d8-af53-405a-8116-4b7a01549bdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG os_vif [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4e4888a-16, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:37:26 user nova-compute[82196]: INFO os_vif [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16')
Apr 11 19:37:27 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlutpRPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:27 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c92d884-84ba-4244-a3a5-30ceb39b2c40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:37:27 user nova-compute[82196]: No targets found.
Apr 11 19:37:27 user nova-compute[82196]: iSNS:
Apr 11 19:37:27 user nova-compute[82196]: No targets found.
Apr 11 19:37:27 user nova-compute[82196]: STATIC:
Apr 11 19:37:27 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574
Apr 11 19:37:27 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:27 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:27 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:37:27 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:27 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:27 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:37:27 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:27 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:27 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e
Apr 11 19:37:27 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:27 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:27 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418
Apr 11 19:37:27 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:27 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:27 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b
Apr 11 19:37:27 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:37:27 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:37:27 user nova-compute[82196]: FIRMWARE:
Apr 11 19:37:27 user nova-compute[82196]: No targets found.
Apr 11 19:37:27 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:37:27 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:37:27 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a1c8df-dfe7-48b9-9299-29bed1cc5798]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b859aff-98de-493b-a474-5e330b2ea8c0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:27 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:27 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:27 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:27 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:27 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:27 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:27 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:27 user nova-compute[82196]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:27 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:27 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:27 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:27 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f924043a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e'): ({'sdd'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Removing single pathed devices sdd {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b078c6-d652-4e25-ae38-c464a9011c18]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2dac3a-0edd-463b-b8c0-72a62295d3aa]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flushing IO for device /dev/sdd {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca4bbb0-db26-4878-8937-3527a16da51e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c86f9d-bb9b-4982-ab63-188d8a382c83]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbdaa61-9093-41d8-9275-1e2585203e21]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b0dc62-7c8b-4a72-a1b2-d995a5e8e52a]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260]
Apr 11 19:37:27 user nova-compute[82196]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260] successful.
Apr 11 19:37:27 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[475ec395-9a8f-49bd-b653-b03305efd7c4]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== disconnect_volume: return (316ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:37:27 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Took 1.25 seconds to deallocate network for instance.
Apr 11 19:37:27 user nova-compute[82196]: DEBUG nova.compute.manager [req-ee28fea6-6d37-49d6-a8ed-8c12d2f45c2c req-b9765bad-1a09-4b8b-b165-664c978d097c service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Received event network-vif-deleted-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Received event network-vif-plugged-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Acquiring lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] No waiting events found dispatching network-vif-plugged-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:28 user nova-compute[82196]: WARNING nova.compute.manager [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Received unexpected event network-vif-plugged-ed9fd5c5-52fb-4d71-9ba0-911eaa1a92a2 for instance with vm_state deleted and task_state None.
Apr 11 19:37:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-unplugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-unplugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:28 user nova-compute[82196]: WARNING nova.compute.manager [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-unplugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state resized and task_state resize_reverting.
Apr 11 19:37:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG nova.compute.manager [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:28 user nova-compute[82196]: WARNING nova.compute.manager [req-6cdc9f3b-3695-4a9b-abef-a59a14301e20 req-dc75d0c7-f117-4e97-8fa4-ba47db04da2b service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state resized and task_state resize_reverting.
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.138s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'migration_context' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:28 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Deleted allocations for instance bd559e67-3c8f-42b4-b1d6-fd171c8850b8
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-737868d7-948b-48d7-be5e-28b954028adc tempest-AttachVolumeTestJSON-2144032498 tempest-AttachVolumeTestJSON-2144032498-project-member] Lock "bd559e67-3c8f-42b4-b1d6-fd171c8850b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.707s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:37:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.500s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:29 user nova-compute[82196]: INFO nova.compute.manager [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Swapping old allocation on dict_keys(['05f5e47c-70b3-42ff-8927-09fa1d35aec2']) held by migration 3c4e7cb9-5bf3-43f1-9585-8956cde90edb for instance
Apr 11 19:37:29 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Overwriting current allocation {'allocations': {'05f5e47c-70b3-42ff-8927-09fa1d35aec2': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 42}}, 'project_id': '60a7381a31b84e97a068528f90813773', 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'consumer_generation': 1} on consumer 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquired lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating instance_info_cache with network_info: [{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Releasing lock "refresh_cache-647674d8-af53-405a-8116-4b7a01549bdf" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG os_brick.utils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3526793-e731-426c-8b4a-7bd01731f10e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbb17be-1f26-4442-a175-8b08afd4e0a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:29 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[81188583-9f6b-41c9-a20f-f2f4d4e52d55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9a376a-8c5d-4cf5-8a92-a930d23b38da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:37:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:37:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:37:30 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:37:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6541f3a0-204f-4dc6-888c-d500bcc4c2bc]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:37:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:37:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:37:30 user nova-compute[82196]: DEBUG os_brick.utils [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Starting finish_revert_migration {{(pid=82196) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Start _get_guest_xml network_info=[{"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlutpRPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '647674d8-af53-405a-8116-4b7a01549bdf', 'attached_at': '2023-04-11T19:37:34.000000', 'detached_at': '', 'volume_id': '8f069dda-26af-4766-b53f-0a831de5011e', 'serial': '8f069dda-26af-4766-b53f-0a831de5011e'}, 'attachment_id': '0e22c313-4eb1-4e53-8b3d-1cd1ad793bd9', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:37:34 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:37:34 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'vcpu_model' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlutpRPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:37:34 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:34 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:37:34 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da7c1b7-99e0-45e6-900d-36f9da7bff61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:37:34 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1060bd8b-e8e3-4bae-9b5f-5d6d299a80ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e] added
Apr 11 19:37:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0f6081-505a-4e81-ad95-c54a0ef02375]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c618f95-76ec-4460-91aa-e09147edefd3]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlutpRPK {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlutpRPK" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e633ccff-d474-4153-b30a-7d39f6ff5214]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WlutpRPK'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d47d03c-b1b6-4472-8b07-be1162ccae34]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe4453d-c1b8-4014-b655-5cf133791a71]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a4da2b-22f8-47ee-861c-aa660d60ec5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260]
Apr 11 19:37:34 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260] successful.
Apr 11 19:37:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cedc948-22f2-4e3b-8ebd-069672ab6240]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b663f7f5-191f-46ac-ac84-4140828d96f1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:37:34 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:37:34 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4733dd5-b06b-4ac5-81c5-4d72773bc1de]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:37:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlutpRPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23630633066396163', 'path': '/dev/sdd'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630633066396163', 'path': '/dev/sdd'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-505347267',display_name='tempest-ServerActionsTestJSON-server-1599172202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-505347267',id=21,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-lxpjy0l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:37:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=647674d8-af53-405a-8116-4b7a01549bdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:37:35 user nova-compute[82196]:   <uuid>647674d8-af53-405a-8116-4b7a01549bdf</uuid>
Apr 11 19:37:35 user nova-compute[82196]:   <name>instance-00000015</name>
Apr 11 19:37:35 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:37:35 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:37:35 user nova-compute[82196]:   <metadata>
Apr 11 19:37:35 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:37:35 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:37:35 user nova-compute[82196]:       <nova:name>tempest-ServerActionsTestJSON-server-1599172202</nova:name>
Apr 11 19:37:35 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:37:34</nova:creationTime>
Apr 11 19:37:35 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:37:35 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:37:35 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:37:35 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:37:35 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:37:35 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:37:35 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:37:35 user nova-compute[82196]:       <nova:owner>
Apr 11 19:37:35 user nova-compute[82196]:         <nova:user uuid="05fb551c320a48f98a4ec00a7f7492d7">tempest-ServerActionsTestJSON-37730514-project-member</nova:user>
Apr 11 19:37:35 user nova-compute[82196]:         <nova:project uuid="60a7381a31b84e97a068528f90813773">tempest-ServerActionsTestJSON-37730514</nova:project>
Apr 11 19:37:35 user nova-compute[82196]:       </nova:owner>
Apr 11 19:37:35 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:37:35 user nova-compute[82196]:       <nova:ports>
Apr 11 19:37:35 user nova-compute[82196]:         <nova:port uuid="e4e4888a-168a-4fe8-a43e-ee683b50a39a">
Apr 11 19:37:35 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 19:37:35 user nova-compute[82196]:         </nova:port>
Apr 11 19:37:35 user nova-compute[82196]:       </nova:ports>
Apr 11 19:37:35 user nova-compute[82196]:     </nova:instance>
Apr 11 19:37:35 user nova-compute[82196]:   </metadata>
Apr 11 19:37:35 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:37:35 user nova-compute[82196]:     <system>
Apr 11 19:37:35 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:37:35 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:37:35 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:37:35 user nova-compute[82196]:       <entry name="serial">647674d8-af53-405a-8116-4b7a01549bdf</entry>
Apr 11 19:37:35 user nova-compute[82196]:       <entry name="uuid">647674d8-af53-405a-8116-4b7a01549bdf</entry>
Apr 11 19:37:35 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:37:35 user nova-compute[82196]:     </system>
Apr 11 19:37:35 user nova-compute[82196]:   </sysinfo>
Apr 11 19:37:35 user nova-compute[82196]:   <os>
Apr 11 19:37:35 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:37:35 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:37:35 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:37:35 user nova-compute[82196]:   </os>
Apr 11 19:37:35 user nova-compute[82196]:   <features>
Apr 11 19:37:35 user nova-compute[82196]:     <acpi/>
Apr 11 19:37:35 user nova-compute[82196]:     <apic/>
Apr 11 19:37:35 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:37:35 user nova-compute[82196]:   </features>
Apr 11 19:37:35 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:37:35 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:37:35 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:37:35 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:37:35 user nova-compute[82196]:   </clock>
Apr 11 19:37:35 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:37:35 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:37:35 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:37:35 user nova-compute[82196]:   </cpu>
Apr 11 19:37:35 user nova-compute[82196]:   <devices>
Apr 11 19:37:35 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:37:35 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:37:35 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk"/>
Apr 11 19:37:35 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:37:35 user nova-compute[82196]:     </disk>
Apr 11 19:37:35 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:37:35 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:37:35 user nova-compute[82196]:       <source dev="/dev/sdd"/>
Apr 11 19:37:35 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:37:35 user nova-compute[82196]:       <serial>8f069dda-26af-4766-b53f-0a831de5011e</serial>
Apr 11 19:37:35 user nova-compute[82196]:     </disk>
Apr 11 19:37:35 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:37:35 user nova-compute[82196]:       <mac address="fa:16:3e:7a:ec:62"/>
Apr 11 19:37:35 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:37:35 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:37:35 user nova-compute[82196]:       <target dev="tape4e4888a-16"/>
Apr 11 19:37:35 user nova-compute[82196]:     </interface>
Apr 11 19:37:35 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:37:35 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/console.log" append="off"/>
Apr 11 19:37:35 user nova-compute[82196]:     </serial>
Apr 11 19:37:35 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:37:35 user nova-compute[82196]:     <video>
Apr 11 19:37:35 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:37:35 user nova-compute[82196]:     </video>
Apr 11 19:37:35 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:37:35 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:37:35 user nova-compute[82196]:     </rng>
Apr 11 19:37:35 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:37:35 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:37:35 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:37:35 user nova-compute[82196]:     </memballoon>
Apr 11 19:37:35 user nova-compute[82196]:   </devices>
Apr 11 19:37:35 user nova-compute[82196]: </domain>
Apr 11 19:37:35 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-505347267',display_name='tempest-ServerActionsTestJSON-server-1599172202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-505347267',id=21,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-lxpjy0l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:37:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=647674d8-af53-405a-8116-4b7a01549bdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG os_vif [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4e4888a-16, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4e4888a-16, col_values=(('external_ids', {'iface-id': 'e4e4888a-168a-4fe8-a43e-ee683b50a39a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:ec:62', 'vm-uuid': '647674d8-af53-405a-8116-4b7a01549bdf'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:37:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:35 user nova-compute[82196]: INFO os_vif [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16')
Apr 11 19:37:36 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241841.4331696, 5d000531-5884-405d-9e17-1dc5f39226d0 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:37:36 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] VM Stopped (Lifecycle Event)
Apr 11 19:37:36 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2fe4de76-ce12-40e3-9dcd-c945e45b331b None None] [instance: 5d000531-5884-405d-9e17-1dc5f39226d0] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:37 user nova-compute[82196]: DEBUG nova.compute.manager [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:37 user nova-compute[82196]: DEBUG nova.compute.manager [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:37 user nova-compute[82196]: WARNING nova.compute.manager [req-37ac67d0-2cf0-4bad-a5d5-8b8aa993cadb req-b3e22dee-7b6d-4eb2-bde2-2049850779da service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state resized and task_state resize_reverting.
Apr 11 19:37:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for 647674d8-af53-405a-8116-4b7a01549bdf due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:37:39 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241859.2717862, 647674d8-af53-405a-8116-4b7a01549bdf => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:37:39 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] VM Resumed (Lifecycle Event)
Apr 11 19:37:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:37:39 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance running successfully.
Apr 11 19:37:39 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] finish_revert_migration finished successfully. {{(pid=82196) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 11 19:37:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:37:39 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 19:37:39 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241859.2736418, 647674d8-af53-405a-8116-4b7a01549bdf => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:37:39 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] VM Started (Lifecycle Event)
Apr 11 19:37:39 user nova-compute[82196]: DEBUG nova.compute.manager [req-0f344c37-0d23-4a6d-8eb4-8582b0b139c7 req-3cf1d3a7-5e38-4747-a835-d3ce50c48abd service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0f344c37-0d23-4a6d-8eb4-8582b0b139c7 req-3cf1d3a7-5e38-4747-a835-d3ce50c48abd service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0f344c37-0d23-4a6d-8eb4-8582b0b139c7 req-3cf1d3a7-5e38-4747-a835-d3ce50c48abd service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0f344c37-0d23-4a6d-8eb4-8582b0b139c7 req-3cf1d3a7-5e38-4747-a835-d3ce50c48abd service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:39 user nova-compute[82196]: DEBUG nova.compute.manager [req-0f344c37-0d23-4a6d-8eb4-8582b0b139c7 req-3cf1d3a7-5e38-4747-a835-d3ce50c48abd service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:39 user nova-compute[82196]: WARNING nova.compute.manager [req-0f344c37-0d23-4a6d-8eb4-8582b0b139c7 req-3cf1d3a7-5e38-4747-a835-d3ce50c48abd service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state resized and task_state resize_reverting.
Apr 11 19:37:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:37:39 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 19:37:39 user nova-compute[82196]: INFO nova.compute.manager [None req-4e07ea7a-83dd-4add-828d-c175191f78f8 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating instance to original state: 'active'
Apr 11 19:37:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:41 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241846.5582113, bd559e67-3c8f-42b4-b1d6-fd171c8850b8 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:37:41 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] VM Stopped (Lifecycle Event)
Apr 11 19:37:41 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f19c6408-16de-448b-a100-4cf0704bfdd3 None None] [instance: bd559e67-3c8f-42b4-b1d6-fd171c8850b8] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:42 user nova-compute[82196]: INFO nova.compute.manager [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Unshelving
Apr 11 19:37:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'pci_requests' on Instance uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:42 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'numa_topology' on Instance uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:42 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:37:42 user nova-compute[82196]: INFO nova.compute.claims [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Claim successful on node user
Apr 11 19:37:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:42 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:42 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:37:42 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:37:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:42 user nova-compute[82196]: INFO nova.network.neutron [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updating port 0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 19:37:43 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:43 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:37:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquired lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:37:43 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:37:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-changed-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Refreshing instance network info cache due to event network-changed-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:37:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] Acquiring lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:37:44 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updating instance_info_cache with network_info: [{"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:37:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Releasing lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:37:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:37:44 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Creating image(s)
Apr 11 19:37:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "/opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "/opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:44 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'trusted_certs' on Instance uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] Acquired lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:37:44 user nova-compute[82196]: DEBUG nova.network.neutron [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Refreshing network info cache for port 0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:37:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "3ea5b866ae2134daa5cf5c9e63fb6905a2143adf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "3ea5b866ae2134daa5cf5c9e63fb6905a2143adf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf.part --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf.part --force-share --output=json" returned: 0 in 0.154s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG nova.virt.images [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] 1f15605f-2e27-4a82-9ce5-094469a70dcc was qcow2, converting to raw {{(pid=82196) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf.part /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf.converted {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf.part /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf.converted" returned: 0 in 0.757s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG nova.network.neutron [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updated VIF entry in instance network info cache for port 0be0dfa4-d8ad-4d32-83ab-a090c0f77f34. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG nova.network.neutron [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updating instance_info_cache with network_info: [{"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf.converted --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:37:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-81fa7efa-4d84-49cc-9716-802cd04776fc req-3ba7007c-c2b3-4a03-95b5-85b432ae2de1 service nova] Releasing lock "refresh_cache-fbfa0825-c7c2-4f04-8c9a-102e238c3816" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf.converted --force-share --output=json" returned: 0 in 0.155s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "3ea5b866ae2134daa5cf5c9e63fb6905a2143adf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.888s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "3ea5b866ae2134daa5cf5c9e63fb6905a2143adf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "3ea5b866ae2134daa5cf5c9e63fb6905a2143adf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf,backing_fmt=raw /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf,backing_fmt=raw /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk 1073741824" returned: 0 in 0.051s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "3ea5b866ae2134daa5cf5c9e63fb6905a2143adf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updating instance_info_cache with network_info: [{"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'migration_context' on Instance uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:46 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Rebasing disk image.
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:46 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 -F raw /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 -F raw /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk" returned: 0 in 2.214s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Ensure instance console log exists: /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Start _get_guest_xml network_info=[{"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7862fa2731fc64e5aa0a357327b8ec5e',container_format='bare',created_at=2023-04-11T19:35:49Z,direct_url=<?>,disk_format='qcow2',id=1f15605f-2e27-4a82-9ce5-094469a70dcc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1228547187-shelved',owner='8d8b189667e34931aa36149620a036e1',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T19:35:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:37:48 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:37:48 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7862fa2731fc64e5aa0a357327b8ec5e',container_format='bare',created_at=2023-04-11T19:35:49Z,direct_url=<?>,disk_format='qcow2',id=1f15605f-2e27-4a82-9ce5-094469a70dcc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1228547187-shelved',owner='8d8b189667e34931aa36149620a036e1',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T19:35:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:37:48 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'vcpu_model' on Instance uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:33:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1228547187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1228547187',id=30,image_ref='1f15605f-2e27-4a82-9ce5-094469a70dcc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1296340783',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:34:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8d8b189667e34931aa36149620a036e1',ramdisk_id='',reservation_id='r-jqpowijw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-427928846',owner_user_name='tempest-AttachVolumeShelveTestJSON-427928846-project-member',shelved_at='2023-04-11T19:35:53.911348',shelved_host='user',shelved_image_id='1f15605f-2e27-4a82-9ce5-094469a70dcc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:37:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0558ba5a2b04d36ba2f2411090cc4e4',uuid=fbfa0825-c7c2-4f04-8c9a-102e238c3816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converting VIF {"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'pci_devices' on Instance uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:37:49 user nova-compute[82196]:   <uuid>fbfa0825-c7c2-4f04-8c9a-102e238c3816</uuid>
Apr 11 19:37:49 user nova-compute[82196]:   <name>instance-0000001e</name>
Apr 11 19:37:49 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:37:49 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:37:49 user nova-compute[82196]:   <metadata>
Apr 11 19:37:49 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:37:49 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:37:49 user nova-compute[82196]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1228547187</nova:name>
Apr 11 19:37:49 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:37:48</nova:creationTime>
Apr 11 19:37:49 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:37:49 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:37:49 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:37:49 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:37:49 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:37:49 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:37:49 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:37:49 user nova-compute[82196]:       <nova:owner>
Apr 11 19:37:49 user nova-compute[82196]:         <nova:user uuid="e0558ba5a2b04d36ba2f2411090cc4e4">tempest-AttachVolumeShelveTestJSON-427928846-project-member</nova:user>
Apr 11 19:37:49 user nova-compute[82196]:         <nova:project uuid="8d8b189667e34931aa36149620a036e1">tempest-AttachVolumeShelveTestJSON-427928846</nova:project>
Apr 11 19:37:49 user nova-compute[82196]:       </nova:owner>
Apr 11 19:37:49 user nova-compute[82196]:       <nova:root type="image" uuid="1f15605f-2e27-4a82-9ce5-094469a70dcc"/>
Apr 11 19:37:49 user nova-compute[82196]:       <nova:ports>
Apr 11 19:37:49 user nova-compute[82196]:         <nova:port uuid="0be0dfa4-d8ad-4d32-83ab-a090c0f77f34">
Apr 11 19:37:49 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 19:37:49 user nova-compute[82196]:         </nova:port>
Apr 11 19:37:49 user nova-compute[82196]:       </nova:ports>
Apr 11 19:37:49 user nova-compute[82196]:     </nova:instance>
Apr 11 19:37:49 user nova-compute[82196]:   </metadata>
Apr 11 19:37:49 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:37:49 user nova-compute[82196]:     <system>
Apr 11 19:37:49 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:37:49 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:37:49 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:37:49 user nova-compute[82196]:       <entry name="serial">fbfa0825-c7c2-4f04-8c9a-102e238c3816</entry>
Apr 11 19:37:49 user nova-compute[82196]:       <entry name="uuid">fbfa0825-c7c2-4f04-8c9a-102e238c3816</entry>
Apr 11 19:37:49 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:37:49 user nova-compute[82196]:     </system>
Apr 11 19:37:49 user nova-compute[82196]:   </sysinfo>
Apr 11 19:37:49 user nova-compute[82196]:   <os>
Apr 11 19:37:49 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:37:49 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:37:49 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:37:49 user nova-compute[82196]:   </os>
Apr 11 19:37:49 user nova-compute[82196]:   <features>
Apr 11 19:37:49 user nova-compute[82196]:     <acpi/>
Apr 11 19:37:49 user nova-compute[82196]:     <apic/>
Apr 11 19:37:49 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:37:49 user nova-compute[82196]:   </features>
Apr 11 19:37:49 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:37:49 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:37:49 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:37:49 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:37:49 user nova-compute[82196]:   </clock>
Apr 11 19:37:49 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:37:49 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:37:49 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:37:49 user nova-compute[82196]:   </cpu>
Apr 11 19:37:49 user nova-compute[82196]:   <devices>
Apr 11 19:37:49 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:37:49 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:37:49 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk"/>
Apr 11 19:37:49 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:37:49 user nova-compute[82196]:     </disk>
Apr 11 19:37:49 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:37:49 user nova-compute[82196]:       <mac address="fa:16:3e:7b:46:50"/>
Apr 11 19:37:49 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:37:49 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:37:49 user nova-compute[82196]:       <target dev="tap0be0dfa4-d8"/>
Apr 11 19:37:49 user nova-compute[82196]:     </interface>
Apr 11 19:37:49 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:37:49 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/console.log" append="off"/>
Apr 11 19:37:49 user nova-compute[82196]:     </serial>
Apr 11 19:37:49 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:37:49 user nova-compute[82196]:     <video>
Apr 11 19:37:49 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:37:49 user nova-compute[82196]:     </video>
Apr 11 19:37:49 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:37:49 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:37:49 user nova-compute[82196]:     </rng>
Apr 11 19:37:49 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:37:49 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:37:49 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:37:49 user nova-compute[82196]:     </memballoon>
Apr 11 19:37:49 user nova-compute[82196]:   </devices>
Apr 11 19:37:49 user nova-compute[82196]: </domain>
Apr 11 19:37:49 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:33:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1228547187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1228547187',id=30,image_ref='1f15605f-2e27-4a82-9ce5-094469a70dcc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1296340783',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:34:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8d8b189667e34931aa36149620a036e1',ramdisk_id='',reservation_id='r-jqpowijw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-427928846',owner_user_name='tempest-AttachVolumeShelveTestJSON-427928846-project-member',shelved_at='2023-04-11T19:35:53.911348',shelved_host='user',shelved_image_id='1f15605f-2e27-4a82-9ce5-094469a70dcc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:37:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0558ba5a2b04d36ba2f2411090cc4e4',uuid=fbfa0825-c7c2-4f04-8c9a-102e238c3816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converting VIF {"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG os_vif [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0be0dfa4-d8, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0be0dfa4-d8, col_values=(('external_ids', {'iface-id': '0be0dfa4-d8ad-4d32-83ab-a090c0f77f34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:46:50', 'vm-uuid': 'fbfa0825-c7c2-4f04-8c9a-102e238c3816'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:49 user nova-compute[82196]: INFO os_vif [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8')
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] No VIF found with MAC fa:16:3e:7b:46:50, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:37:49 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:37:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:37:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:37:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:37:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:37:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241873.140802, fbfa0825-c7c2-4f04-8c9a-102e238c3816 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:37:53 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] VM Resumed (Lifecycle Event)
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-fce149ed-5755-49cf-895a-f67d0f5645e3 req-4176f092-699e-4b5d-8510-5fa83f6e370c service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fce149ed-5755-49cf-895a-f67d0f5645e3 req-4176f092-699e-4b5d-8510-5fa83f6e370c service nova] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fce149ed-5755-49cf-895a-f67d0f5645e3 req-4176f092-699e-4b5d-8510-5fa83f6e370c service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fce149ed-5755-49cf-895a-f67d0f5645e3 req-4176f092-699e-4b5d-8510-5fa83f6e370c service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-fce149ed-5755-49cf-895a-f67d0f5645e3 req-4176f092-699e-4b5d-8510-5fa83f6e370c service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] No waiting events found dispatching network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:53 user nova-compute[82196]: WARNING nova.compute.manager [req-fce149ed-5755-49cf-895a-f67d0f5645e3 req-4176f092-699e-4b5d-8510-5fa83f6e370c service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received unexpected event network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-68fe5980-91c7-46d8-ad68-e5461adcdad2 req-76dfefab-b39d-4ebe-9842-cab8f4f1a3a1 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-68fe5980-91c7-46d8-ad68-e5461adcdad2 req-76dfefab-b39d-4ebe-9842-cab8f4f1a3a1 service nova] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-68fe5980-91c7-46d8-ad68-e5461adcdad2 req-76dfefab-b39d-4ebe-9842-cab8f4f1a3a1 service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-68fe5980-91c7-46d8-ad68-e5461adcdad2 req-76dfefab-b39d-4ebe-9842-cab8f4f1a3a1 service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-68fe5980-91c7-46d8-ad68-e5461adcdad2 req-76dfefab-b39d-4ebe-9842-cab8f4f1a3a1 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] No waiting events found dispatching network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:37:53 user nova-compute[82196]: WARNING nova.compute.manager [req-68fe5980-91c7-46d8-ad68-e5461adcdad2 req-76dfefab-b39d-4ebe-9842-cab8f4f1a3a1 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received unexpected event network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:53 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Instance spawned successfully.
Apr 11 19:37:53 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:37:53 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7701MB free_disk=26.122509002685547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:37:53 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241873.1419191, fbfa0825-c7c2-4f04-8c9a-102e238c3816 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:37:53 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] VM Started (Lifecycle Event)
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:37:53 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance b079367a-558e-4920-ad8d-972a8065260c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance afc22926-012a-43fe-99e6-063294c593a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance d42dc0ea-4631-44be-8b58-09877280ba2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 781f3398-3d54-49a4-a751-60f4fbc5e49a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (05f5e47c-70b3-42ff-8927-09fa1d35aec2): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1705}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing inventories for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Updating ProviderTree inventory for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Updating inventory in ProviderTree for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing aggregate associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, aggregates: None {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8336c00d-4aaf-4538-b69c-15b2e39e258c tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.529s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing trait associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:37:53 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:37:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:37:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.694s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:37:54 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 19:37:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] There are 0 instances to clean {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 19:37:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:37:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82196) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 19:37:56 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:37:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:37:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-changed-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Refreshing instance network info cache due to event network-changed-fd43e974-64b6-4605-83cb-11b9cfe58341. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:38:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] Acquiring lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:38:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] Acquired lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:38:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Refreshing network info cache for port fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:38:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:10 user nova-compute[82196]: INFO nova.compute.manager [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Shelve offloading
Apr 11 19:38:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updated VIF entry in instance network info cache for port fd43e974-64b6-4605-83cb-11b9cfe58341. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:38:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updating instance_info_cache with network_info: [{"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:38:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4d349c9f-78a1-4ebd-b7bf-ac3c08ae90f4 req-9a16fafc-a426-4484-a84c-4ae8eb5c3cf4 service nova] Releasing lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:38:11 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Instance destroyed successfully.
Apr 11 19:38:11 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:38:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:38:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquired lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:38:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:38:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updating instance_info_cache with network_info: [{"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Releasing lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-vif-unplugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] No waiting events found dispatching network-vif-unplugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:38:12 user nova-compute[82196]: WARNING nova.compute.manager [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received unexpected event network-vif-unplugged-fd43e974-64b6-4605-83cb-11b9cfe58341 for instance with vm_state active and task_state shelving.
Apr 11 19:38:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] No waiting events found dispatching network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:38:12 user nova-compute[82196]: WARNING nova.compute.manager [req-89131a88-a31e-400a-be84-524c622b1d31 req-11f847e7-686a-4230-aa44-3359e17d870a service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received unexpected event network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 for instance with vm_state active and task_state shelving.
Apr 11 19:38:12 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Instance destroyed successfully.
Apr 11 19:38:12 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lazy-loading 'resources' on Instance uuid d42dc0ea-4631-44be-8b58-09877280ba2e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-63091414',display_name='tempest-TestShelveInstance-server-63091414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-63091414',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWOJEcAet7cYNYxgnjtKjY7EQdZEK+sNwCTk8xWL8WixGkKk2vUONnTt9oMkdV+yembu+c8rHexAl3dfd0YzfkTAZ1D5FG2Y66/ZHnUkpqMPcyP8plrDur+CPwxyvFqNQ==',key_name='tempest-TestShelveInstance-1765937682',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:36:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7b9baa081ca455ea6931b7801c805b8',ramdisk_id='',reservation_id='r-90gk500j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1694566228',owner_user_name='tempest-TestShelveInstance-1694566228-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:36:31Z,user_data=None,user_id='68fcdcd3af164195bf0c7da3b8dfecb7',uuid=d42dc0ea-4631-44be-8b58-09877280ba2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Converting VIF {"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG os_vif [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-changed-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Refreshing instance network info cache due to event network-changed-fd43e974-64b6-4605-83cb-11b9cfe58341. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] Acquiring lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] Acquired lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG nova.network.neutron [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Refreshing network info cache for port fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd43e974-64, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:38:12 user nova-compute[82196]: INFO os_vif [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64')
Apr 11 19:38:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arNXGbxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:38:12 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:38:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:38:12 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[335a8a68-d789-4fad-90fc-ce76477943ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:38:13 user nova-compute[82196]: No targets found.
Apr 11 19:38:13 user nova-compute[82196]: iSNS:
Apr 11 19:38:13 user nova-compute[82196]: No targets found.
Apr 11 19:38:13 user nova-compute[82196]: STATIC:
Apr 11 19:38:13 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574
Apr 11 19:38:13 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:38:13 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:38:13 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:38:13 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:38:13 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:38:13 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:38:13 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:38:13 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:38:13 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e
Apr 11 19:38:13 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:38:13 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:38:13 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418
Apr 11 19:38:13 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:38:13 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:38:13 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b
Apr 11 19:38:13 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:38:13 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:38:13 user nova-compute[82196]: FIRMWARE:
Apr 11 19:38:13 user nova-compute[82196]: No targets found.
Apr 11 19:38:13 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:38:13 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:38:13 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe5bd43-d3d5-4352-a0c6-eb36d85f5cb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a8c5c7-a074-4303-a019-3572ec657580]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:38:13 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:38:13 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:38:13 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:38:13 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:38:13 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:38:13 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:38:13 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:38:13 user nova-compute[82196]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:38:13 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:38:13 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:38:13 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:38:13 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f926414ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418'): ({'sde'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Removing single pathed devices sde {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c522cc9b-9e5c-4a3e-882c-b7a8a71127b5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb934265-60fa-45c9-b487-7a4bf5dbeba6]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Flushing IO for device /dev/sde {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a05b04-80e2-464c-9b69-e89ef9dc6631]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[086fe24a-54cf-426b-a525-85d39d609a46]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] SCSI volumes sde have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4433f28e-7fb1-4e9c-994f-7596269db738]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[de80c489-709e-4b00-b5a8-72408f467ace]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260]
Apr 11 19:38:13 user nova-compute[82196]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260] successful.
Apr 11 19:38:13 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbc3cd2-0ac9-44d8-9368-87769421d363]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] <== disconnect_volume: return (353ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:38:13 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Deleting instance files /opt/stack/data/nova/instances/d42dc0ea-4631-44be-8b58-09877280ba2e_del
Apr 11 19:38:13 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Deletion of /opt/stack/data/nova/instances/d42dc0ea-4631-44be-8b58-09877280ba2e_del complete
Apr 11 19:38:13 user nova-compute[82196]: DEBUG nova.network.neutron [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updated VIF entry in instance network info cache for port fd43e974-64b6-4605-83cb-11b9cfe58341. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG nova.network.neutron [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updating instance_info_cache with network_info: [{"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": null, "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfd43e974-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:38:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-645006a8-f411-4c6c-98ec-36f81576ea85 req-d6c11e76-6736-4be0-ae8c-0fe04ad3762a service nova] Releasing lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:38:14 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Deleted allocations for instance d42dc0ea-4631-44be-8b58-09877280ba2e
Apr 11 19:38:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:14 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lazy-loading 'numa_topology' on Instance uuid d42dc0ea-4631-44be-8b58-09877280ba2e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:38:14 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:38:14 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:38:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a3235533-ce8f-4c57-b19a-e7d4d89da1cf tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.347s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:38:19 user nova-compute[82196]: INFO nova.compute.claims [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Claim successful on node user
Apr 11 19:38:19 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG nova.network.neutron [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:38:19 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:38:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG nova.policy [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba7f82b529e74d99838b6264b94d823b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3a291c54b49db8e12a88ba41865e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:38:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:38:19 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Creating image(s)
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "/opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "/opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.170s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.150s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk 1073741824" returned: 0 in 0.053s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Cannot resize image /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG nova.objects.instance [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'migration_context' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Ensure instance console log exists: /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:20 user nova-compute[82196]: DEBUG nova.network.neutron [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Successfully created port: c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG nova.network.neutron [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Successfully updated port: c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquired lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG nova.network.neutron [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-changed-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Refreshing instance network info cache due to event network-changed-c662b1b3-b2b3-4502-81af-9afdf3e591dc. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] Acquiring lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG nova.network.neutron [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG nova.network.neutron [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updating instance_info_cache with network_info: [{"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Releasing lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG nova.compute.manager [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Instance network_info: |[{"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] Acquired lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG nova.network.neutron [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Refreshing network info cache for port c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:38:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Start _get_guest_xml network_info=[{"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:38:22 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:38:22 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1910984367',display_name='tempest-ServerRescueNegativeTestJSON-server-1910984367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1910984367',id=38,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOg6Hf94pVltDkkNWWRUkyDdm5FkHOFas15WTV4ELfursaPozu4TbpoIUk0HP0VHxjYdcQgsc8wfNgH6fYZasAgDxzJ8ujV0YM5uYIVaN2C0LA5O+gHU06Xkv+AxumfVcw==',key_name='tempest-keypair-1079379697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8e3a291c54b49db8e12a88ba41865e3',ramdisk_id='',reservation_id='r-m984i7hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1429831687',owner_user_name='tempest-ServerRescueNegativeTestJSON-1429831687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba7f82b529e74d99838b6264b94d823b',uuid=bf0a75f5-2f44-4687-af12-046f6761fee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converting VIF {"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:43:8c,bridge_name='br-int',has_traffic_filtering=True,id=c662b1b3-b2b3-4502-81af-9afdf3e591dc,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc662b1b3-b2') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.objects.instance [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'pci_devices' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:38:22 user nova-compute[82196]:   <uuid>bf0a75f5-2f44-4687-af12-046f6761fee2</uuid>
Apr 11 19:38:22 user nova-compute[82196]:   <name>instance-00000026</name>
Apr 11 19:38:22 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:38:22 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:38:22 user nova-compute[82196]:   <metadata>
Apr 11 19:38:22 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:38:22 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:38:22 user nova-compute[82196]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1910984367</nova:name>
Apr 11 19:38:22 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:38:22</nova:creationTime>
Apr 11 19:38:22 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:38:22 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:38:22 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:38:22 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:38:22 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:38:22 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:38:22 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:38:22 user nova-compute[82196]:       <nova:owner>
Apr 11 19:38:22 user nova-compute[82196]:         <nova:user uuid="ba7f82b529e74d99838b6264b94d823b">tempest-ServerRescueNegativeTestJSON-1429831687-project-member</nova:user>
Apr 11 19:38:22 user nova-compute[82196]:         <nova:project uuid="b8e3a291c54b49db8e12a88ba41865e3">tempest-ServerRescueNegativeTestJSON-1429831687</nova:project>
Apr 11 19:38:22 user nova-compute[82196]:       </nova:owner>
Apr 11 19:38:22 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:38:22 user nova-compute[82196]:       <nova:ports>
Apr 11 19:38:22 user nova-compute[82196]:         <nova:port uuid="c662b1b3-b2b3-4502-81af-9afdf3e591dc">
Apr 11 19:38:22 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:38:22 user nova-compute[82196]:         </nova:port>
Apr 11 19:38:22 user nova-compute[82196]:       </nova:ports>
Apr 11 19:38:22 user nova-compute[82196]:     </nova:instance>
Apr 11 19:38:22 user nova-compute[82196]:   </metadata>
Apr 11 19:38:22 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:38:22 user nova-compute[82196]:     <system>
Apr 11 19:38:22 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:38:22 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:38:22 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:38:22 user nova-compute[82196]:       <entry name="serial">bf0a75f5-2f44-4687-af12-046f6761fee2</entry>
Apr 11 19:38:22 user nova-compute[82196]:       <entry name="uuid">bf0a75f5-2f44-4687-af12-046f6761fee2</entry>
Apr 11 19:38:22 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:38:22 user nova-compute[82196]:     </system>
Apr 11 19:38:22 user nova-compute[82196]:   </sysinfo>
Apr 11 19:38:22 user nova-compute[82196]:   <os>
Apr 11 19:38:22 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:38:22 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:38:22 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:38:22 user nova-compute[82196]:   </os>
Apr 11 19:38:22 user nova-compute[82196]:   <features>
Apr 11 19:38:22 user nova-compute[82196]:     <acpi/>
Apr 11 19:38:22 user nova-compute[82196]:     <apic/>
Apr 11 19:38:22 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:38:22 user nova-compute[82196]:   </features>
Apr 11 19:38:22 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:38:22 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:38:22 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:38:22 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:38:22 user nova-compute[82196]:   </clock>
Apr 11 19:38:22 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:38:22 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:38:22 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:38:22 user nova-compute[82196]:   </cpu>
Apr 11 19:38:22 user nova-compute[82196]:   <devices>
Apr 11 19:38:22 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:38:22 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:38:22 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk"/>
Apr 11 19:38:22 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:38:22 user nova-compute[82196]:     </disk>
Apr 11 19:38:22 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:38:22 user nova-compute[82196]:       <mac address="fa:16:3e:16:43:8c"/>
Apr 11 19:38:22 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:38:22 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:38:22 user nova-compute[82196]:       <target dev="tapc662b1b3-b2"/>
Apr 11 19:38:22 user nova-compute[82196]:     </interface>
Apr 11 19:38:22 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:38:22 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/console.log" append="off"/>
Apr 11 19:38:22 user nova-compute[82196]:     </serial>
Apr 11 19:38:22 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:38:22 user nova-compute[82196]:     <video>
Apr 11 19:38:22 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:38:22 user nova-compute[82196]:     </video>
Apr 11 19:38:22 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:38:22 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:38:22 user nova-compute[82196]:     </rng>
Apr 11 19:38:22 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:38:22 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:38:22 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:38:22 user nova-compute[82196]:     </memballoon>
Apr 11 19:38:22 user nova-compute[82196]:   </devices>
Apr 11 19:38:22 user nova-compute[82196]: </domain>
Apr 11 19:38:22 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1910984367',display_name='tempest-ServerRescueNegativeTestJSON-server-1910984367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1910984367',id=38,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOg6Hf94pVltDkkNWWRUkyDdm5FkHOFas15WTV4ELfursaPozu4TbpoIUk0HP0VHxjYdcQgsc8wfNgH6fYZasAgDxzJ8ujV0YM5uYIVaN2C0LA5O+gHU06Xkv+AxumfVcw==',key_name='tempest-keypair-1079379697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8e3a291c54b49db8e12a88ba41865e3',ramdisk_id='',reservation_id='r-m984i7hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1429831687',owner_user_name='tempest-ServerRescueNegativeTestJSON-1429831687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba7f82b529e74d99838b6264b94d823b',uuid=bf0a75f5-2f44-4687-af12-046f6761fee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converting VIF {"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:43:8c,bridge_name='br-int',has_traffic_filtering=True,id=c662b1b3-b2b3-4502-81af-9afdf3e591dc,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc662b1b3-b2') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG os_vif [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:43:8c,bridge_name='br-int',has_traffic_filtering=True,id=c662b1b3-b2b3-4502-81af-9afdf3e591dc,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc662b1b3-b2') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc662b1b3-b2, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc662b1b3-b2, col_values=(('external_ids', {'iface-id': 'c662b1b3-b2b3-4502-81af-9afdf3e591dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:43:8c', 'vm-uuid': 'bf0a75f5-2f44-4687-af12-046f6761fee2'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:22 user nova-compute[82196]: INFO os_vif [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:43:8c,bridge_name='br-int',has_traffic_filtering=True,id=c662b1b3-b2b3-4502-81af-9afdf3e591dc,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc662b1b3-b2')
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No VIF found with MAC fa:16:3e:16:43:8c, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.network.neutron [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updated VIF entry in instance network info cache for port c662b1b3-b2b3-4502-81af-9afdf3e591dc. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG nova.network.neutron [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updating instance_info_cache with network_info: [{"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:38:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3b3b7f34-c7d7-45a1-a3e6-1c6fd86652da req-9653c022-8433-4b52-85df-2706ba3cbc38 service nova] Releasing lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:38:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-acafccee-7f91-43a3-baaa-f5e201c954de req-96e56674-7019-425c-b55b-8902448348b3 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-acafccee-7f91-43a3-baaa-f5e201c954de req-96e56674-7019-425c-b55b-8902448348b3 service nova] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-acafccee-7f91-43a3-baaa-f5e201c954de req-96e56674-7019-425c-b55b-8902448348b3 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-acafccee-7f91-43a3-baaa-f5e201c954de req-96e56674-7019-425c-b55b-8902448348b3 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [req-acafccee-7f91-43a3-baaa-f5e201c954de req-96e56674-7019-425c-b55b-8902448348b3 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] No waiting events found dispatching network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:38:24 user nova-compute[82196]: WARNING nova.compute.manager [req-acafccee-7f91-43a3-baaa-f5e201c954de req-96e56674-7019-425c-b55b-8902448348b3 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received unexpected event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance with vm_state building and task_state spawning.
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 864fcd9b-8e5b-4de8-a2e6-292a8907a834 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 6f2616ce-4924-4b82-996a-2596ae8856a4 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid b079367a-558e-4920-ad8d-972a8065260c {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid afc22926-012a-43fe-99e6-063294c593a6 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 781f3398-3d54-49a4-a751-60f4fbc5e49a {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "647674d8-af53-405a-8116-4b7a01549bdf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "b079367a-558e-4920-ad8d-972a8065260c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "b079367a-558e-4920-ad8d-972a8065260c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "afc22926-012a-43fe-99e6-063294c593a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "afc22926-012a-43fe-99e6-063294c593a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "781f3398-3d54-49a4-a751-60f4fbc5e49a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "647674d8-af53-405a-8116-4b7a01549bdf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "afc22926-012a-43fe-99e6-063294c593a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "b079367a-558e-4920-ad8d-972a8065260c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241906.097031, bf0a75f5-2f44-4687-af12-046f6761fee2 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:38:26 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] VM Resumed (Lifecycle Event)
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:38:26 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Instance spawned successfully.
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:38:26 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241906.1011803, bf0a75f5-2f44-4687-af12-046f6761fee2 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:38:26 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] VM Started (Lifecycle Event)
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:38:26 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-ed2d7d5c-fd6e-4672-a364-ed56284e3024 req-750f429e-48c0-4ac2-822b-64d2b5d65978 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ed2d7d5c-fd6e-4672-a364-ed56284e3024 req-750f429e-48c0-4ac2-822b-64d2b5d65978 service nova] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ed2d7d5c-fd6e-4672-a364-ed56284e3024 req-750f429e-48c0-4ac2-822b-64d2b5d65978 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ed2d7d5c-fd6e-4672-a364-ed56284e3024 req-750f429e-48c0-4ac2-822b-64d2b5d65978 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.compute.manager [req-ed2d7d5c-fd6e-4672-a364-ed56284e3024 req-750f429e-48c0-4ac2-822b-64d2b5d65978 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] No waiting events found dispatching network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:38:26 user nova-compute[82196]: WARNING nova.compute.manager [req-ed2d7d5c-fd6e-4672-a364-ed56284e3024 req-750f429e-48c0-4ac2-822b-64d2b5d65978 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received unexpected event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance with vm_state building and task_state spawning.
Apr 11 19:38:26 user nova-compute[82196]: INFO nova.compute.manager [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Took 6.24 seconds to spawn the instance on the hypervisor.
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:38:26 user nova-compute[82196]: INFO nova.compute.manager [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Took 7.18 seconds to build instance.
Apr 11 19:38:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c8f316cd-89ab-4376-876e-ab2f9149a71e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.288s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.126s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:26 user nova-compute[82196]: INFO nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:38:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241891.4491892, d42dc0ea-4631-44be-8b58-09877280ba2e => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:38:26 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] VM Stopped (Lifecycle Event)
Apr 11 19:38:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d3799259-2ce4-411b-82d8-1f1ee60de05e None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:38:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "781f3398-3d54-49a4-a751-60f4fbc5e49a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:40 user nova-compute[82196]: INFO nova.compute.manager [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Terminating instance
Apr 11 19:38:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:38:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:41 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Instance destroyed successfully.
Apr 11 19:38:41 user nova-compute[82196]: DEBUG nova.objects.instance [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lazy-loading 'resources' on Instance uuid 781f3398-3d54-49a4-a751-60f4fbc5e49a {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:36:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-783988854',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-783988854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-783988854',id=36,image_ref='24fc25bd-3ef8-478b-87dc-434d48415b06',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:37:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-f1he0ws0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-935343500',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:37:08Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=781f3398-3d54-49a4-a751-60f4fbc5e49a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb83845b-f94f-422d-9970-c00e62a4b142", "address": "fa:16:3e:68:ac:32", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb83845b-f9", "ovs_interfaceid": "eb83845b-f94f-422d-9970-c00e62a4b142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "eb83845b-f94f-422d-9970-c00e62a4b142", "address": "fa:16:3e:68:ac:32", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb83845b-f9", "ovs_interfaceid": "eb83845b-f94f-422d-9970-c00e62a4b142", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:32,bridge_name='br-int',has_traffic_filtering=True,id=eb83845b-f94f-422d-9970-c00e62a4b142,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb83845b-f9') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_vif [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:32,bridge_name='br-int',has_traffic_filtering=True,id=eb83845b-f94f-422d-9970-c00e62a4b142,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb83845b-f9') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb83845b-f9, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:38:41 user nova-compute[82196]: INFO os_vif [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:32,bridge_name='br-int',has_traffic_filtering=True,id=eb83845b-f94f-422d-9970-c00e62a4b142,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb83845b-f9')
Apr 11 19:38:41 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMpdsYVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:38:41 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-e9a52476-8aaa-4e68-af97-f48d22d51d55 req-571c6d4c-ecd2-4a5f-bec5-e36af230fd2f service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Received event network-vif-unplugged-eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e9a52476-8aaa-4e68-af97-f48d22d51d55 req-571c6d4c-ecd2-4a5f-bec5-e36af230fd2f service nova] Acquiring lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e9a52476-8aaa-4e68-af97-f48d22d51d55 req-571c6d4c-ecd2-4a5f-bec5-e36af230fd2f service nova] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e9a52476-8aaa-4e68-af97-f48d22d51d55 req-571c6d4c-ecd2-4a5f-bec5-e36af230fd2f service nova] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-e9a52476-8aaa-4e68-af97-f48d22d51d55 req-571c6d4c-ecd2-4a5f-bec5-e36af230fd2f service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] No waiting events found dispatching network-vif-unplugged-eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-e9a52476-8aaa-4e68-af97-f48d22d51d55 req-571c6d4c-ecd2-4a5f-bec5-e36af230fd2f service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Received event network-vif-unplugged-eb83845b-f94f-422d-9970-c00e62a4b142 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e770f62-91f9-4c73-971b-80354aa5eb8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:38:41 user nova-compute[82196]: No targets found.
Apr 11 19:38:41 user nova-compute[82196]: iSNS:
Apr 11 19:38:41 user nova-compute[82196]: No targets found.
Apr 11 19:38:41 user nova-compute[82196]: STATIC:
Apr 11 19:38:41 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574
Apr 11 19:38:41 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:38:41 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:38:41 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:38:41 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:38:41 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:38:41 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:38:41 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:38:41 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:38:41 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e
Apr 11 19:38:41 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:38:41 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:38:41 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b
Apr 11 19:38:41 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:38:41 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:38:41 user nova-compute[82196]: FIRMWARE:
Apr 11 19:38:41 user nova-compute[82196]: No targets found.
Apr 11 19:38:41 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:38:41 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:38:41 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[016a404d-3851-491b-9f89-0b11002fc4a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4274637e-501f-44b7-b91a-d2d25dfbacd1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:38:41 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:38:41 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:38:41 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:38:41 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:38:41 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:38:41 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:38:41 user nova-compute[82196]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b (non-flash)
Apr 11 19:38:41 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:38:41 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:38:41 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92741135b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b'): ({'sdf'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Removing single pathed devices sdf {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf5a978-46b1-4d3c-99de-840b286dd7f0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[faee06cd-925b-4557-b8e3-1bf2d490e681]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flushing IO for device /dev/sdf {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8930aa-db3a-48a8-bea0-1ee0a7ce3ede]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f28a92f-5e79-402b-aa44-c5ba079d84a6]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] SCSI volumes sdf have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9343d0db-d490-423a-b8b3-b836e98ccc70]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7143b016-7e2b-443a-a62d-e9a599d58a22]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b, portal: 172.16.0.220,3260]
Apr 11 19:38:41 user nova-compute[82196]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b, portal: 172.16.0.220,3260] successful.
Apr 11 19:38:41 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c5a627-5807-4f3d-8d02-d01cb358784b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0210ffed-949a-41e9-8528-df1d30e7588e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== disconnect_volume: return (365ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:38:41 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Deleting instance files /opt/stack/data/nova/instances/781f3398-3d54-49a4-a751-60f4fbc5e49a_del
Apr 11 19:38:41 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Deletion of /opt/stack/data/nova/instances/781f3398-3d54-49a4-a751-60f4fbc5e49a_del complete
Apr 11 19:38:41 user nova-compute[82196]: INFO nova.compute.manager [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Took 1.24 seconds to destroy the instance on the hypervisor.
Apr 11 19:38:41 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:38:41 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:38:42 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:38:42 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Took 0.51 seconds to deallocate network for instance.
Apr 11 19:38:43 user nova-compute[82196]: INFO nova.compute.manager [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Took 0.90 seconds to detach 1 volumes for instance.
Apr 11 19:38:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Deleting volume: c9c5a627-5807-4f3d-8d02-d01cb358784b {{(pid=82196) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 19:38:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Received event network-vif-plugged-eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] Acquiring lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] No waiting events found dispatching network-vif-plugged-eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:38:43 user nova-compute[82196]: WARNING nova.compute.manager [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Received unexpected event network-vif-plugged-eb83845b-f94f-422d-9970-c00e62a4b142 for instance with vm_state deleted and task_state None.
Apr 11 19:38:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-67340bdb-dcf7-4f4c-82a3-690fa2281248 req-6bfd0de4-70f5-47da-ad08-8347e38923df service nova] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Received event network-vif-deleted-eb83845b-f94f-422d-9970-c00e62a4b142 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:43 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:38:43 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:38:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:43 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Deleted allocations for instance 781f3398-3d54-49a4-a751-60f4fbc5e49a
Apr 11 19:38:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-389a0100-024c-4d2f-bf07-1032ef6062a0 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "781f3398-3d54-49a4-a751-60f4fbc5e49a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.342s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:38:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:38:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:38:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:38:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:38:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:38:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:38:46 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:38:46 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Updating instance_info_cache with network_info: [{"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:38:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:38:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:38:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:38:47 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:38:50 user nova-compute[82196]: INFO nova.compute.manager [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Rescuing
Apr 11 19:38:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "refresh_cache-8c45de50-92bc-467c-9f3d-7e667e1d0bb3" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquired lock "refresh_cache-8c45de50-92bc-467c-9f3d-7e667e1d0bb3" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:38:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Updating instance_info_cache with network_info: [{"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Releasing lock "refresh_cache-8c45de50-92bc-467c-9f3d-7e667e1d0bb3" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG nova.compute.manager [req-687ef340-69d4-41be-9eac-394a0d9febaa req-9ab49628-9a5f-42eb-85ee-33fce8dbf5e4 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-unplugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-687ef340-69d4-41be-9eac-394a0d9febaa req-9ab49628-9a5f-42eb-85ee-33fce8dbf5e4 service nova] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-687ef340-69d4-41be-9eac-394a0d9febaa req-9ab49628-9a5f-42eb-85ee-33fce8dbf5e4 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-687ef340-69d4-41be-9eac-394a0d9febaa req-9ab49628-9a5f-42eb-85ee-33fce8dbf5e4 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG nova.compute.manager [req-687ef340-69d4-41be-9eac-394a0d9febaa req-9ab49628-9a5f-42eb-85ee-33fce8dbf5e4 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] No waiting events found dispatching network-vif-unplugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:38:51 user nova-compute[82196]: WARNING nova.compute.manager [req-687ef340-69d4-41be-9eac-394a0d9febaa req-9ab49628-9a5f-42eb-85ee-33fce8dbf5e4 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received unexpected event network-vif-unplugged-82ee2878-c477-419c-97ba-9ac4b36dacab for instance with vm_state active and task_state rescuing.
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:38:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Instance destroyed successfully.
Apr 11 19:38:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Attempting a stable device rescue
Apr 11 19:38:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82196) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Instance directory exists: not creating {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 19:38:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Creating image(s)
Apr 11 19:38:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "/opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "/opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10.part --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.881s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10.part --force-share --output=json" returned: 0 in 0.149s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG nova.virt.images [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] bfa897bc-dbd2-4019-9649-f67af551a372 was qcow2, converting to raw {{(pid=82196) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10.part /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10.converted {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10.part /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10.converted" returned: 0 in 0.489s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10.converted --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-5a04daaa-c255-4efa-910a-b7b9341f88b5 req-8a15a481-74ea-4046-8bd4-2b2b4fdc3da8 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5a04daaa-c255-4efa-910a-b7b9341f88b5 req-8a15a481-74ea-4046-8bd4-2b2b4fdc3da8 service nova] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5a04daaa-c255-4efa-910a-b7b9341f88b5 req-8a15a481-74ea-4046-8bd4-2b2b4fdc3da8 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-5a04daaa-c255-4efa-910a-b7b9341f88b5 req-8a15a481-74ea-4046-8bd4-2b2b4fdc3da8 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-5a04daaa-c255-4efa-910a-b7b9341f88b5 req-8a15a481-74ea-4046-8bd4-2b2b4fdc3da8 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] No waiting events found dispatching network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:38:54 user nova-compute[82196]: WARNING nova.compute.manager [req-5a04daaa-c255-4efa-910a-b7b9341f88b5 req-8a15a481-74ea-4046-8bd4-2b2b4fdc3da8 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received unexpected event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab for instance with vm_state active and task_state rescuing.
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10.converted --force-share --output=json" returned: 0 in 0.539s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.071s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:54 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:38:54 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7696MB free_disk=26.16769790649414GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10 --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10,backing_fmt=raw /opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/disk.rescue {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10,backing_fmt=raw /opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/disk.rescue" returned: 0 in 0.055s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'migration_context' on Instance uuid 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Start _get_guest_xml network_info=[{"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "vif_mac": "fa:16:3e:27:09:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bfa897bc-dbd2-4019-9649-f67af551a372', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIifBHeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '8c45de50-92bc-467c-9f3d-7e667e1d0bb3', 'attached_at': '', 'detached_at': '', 'volume_id': 'e13194fc-7f97-44b9-afa8-9380e7358af8', 'serial': 'e13194fc-7f97-44b9-afa8-9380e7358af8'}, 'attachment_id': 'a3a4dc7b-edc5-47d1-8608-34ba6cd5b913', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'resources' on Instance uuid 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance b079367a-558e-4920-ad8d-972a8065260c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance afc22926-012a-43fe-99e6-063294c593a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bf0a75f5-2f44-4687-af12-046f6761fee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:38:54 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:38:54 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIifBHeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:38:54 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:38:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:38:54 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:38:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:38:54 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9163d014-bd5d-446d-937e-26848f495f1e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dIifBHeC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 19:38:54 user nova-compute[82196]: node.name = iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:38:54 user nova-compute[82196]: node.tpgt = -1
Apr 11 19:38:54 user nova-compute[82196]: node.startup = automatic
Apr 11 19:38:54 user nova-compute[82196]: node.leading_login = No
Apr 11 19:38:54 user nova-compute[82196]: iface.iscsi_ifacename = default
Apr 11 19:38:54 user nova-compute[82196]: iface.net_ifacename = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.ipaddress = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.prefix_len = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.hwaddress = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.transport_name = tcp
Apr 11 19:38:54 user nova-compute[82196]: iface.initiatorname = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.state = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.vlan_id = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.vlan_priority = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.vlan_state = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.iface_num = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.mtu = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.port = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.bootproto = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.subnet_mask = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.gateway = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.dhcp_alt_client_id = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.dhcp_dns = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.dhcp_learn_iqn = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.dhcp_vendor_id_state = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.dhcp_vendor_id = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.dhcp_slp_da = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.fragmentation = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.gratuitous_arp = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.incoming_forwarding = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.tos_state = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.tos = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.ttl = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.delayed_ack = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.tcp_nagle = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.tcp_wsf_state = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.tcp_wsf = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.tcp_timer_scale = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.tcp_timestamp = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.redirect = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.def_task_mgmt_timeout = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.header_digest = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.data_digest = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.immediate_data = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.initial_r2t = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.data_seq_inorder = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.data_pdu_inorder = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.erl = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.max_receive_data_len = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.first_burst_len = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.max_outstanding_r2t = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.max_burst_len = 0
Apr 11 19:38:54 user nova-compute[82196]: iface.chap_auth = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.bidi_chap = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.strict_login_compliance = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.discovery_auth = <empty>
Apr 11 19:38:54 user nova-compute[82196]: iface.discovery_logout = <empty>
Apr 11 19:38:54 user nova-compute[82196]: node.discovery_address = <empty>
Apr 11 19:38:54 user nova-compute[82196]: node.discovery_port = 0
Apr 11 19:38:54 user nova-compute[82196]: node.discovery_type = static
Apr 11 19:38:54 user nova-compute[82196]: node.session.initial_cmdsn = 0
Apr 11 19:38:54 user nova-compute[82196]: node.session.initial_login_retry_max = 8
Apr 11 19:38:54 user nova-compute[82196]: node.session.xmit_thread_priority = -20
Apr 11 19:38:54 user nova-compute[82196]: node.session.cmds_max = 128
Apr 11 19:38:54 user nova-compute[82196]: node.session.queue_depth = 32
Apr 11 19:38:54 user nova-compute[82196]: node.session.nr_sessions = 1
Apr 11 19:38:54 user nova-compute[82196]: node.session.auth.authmethod = CHAP
Apr 11 19:38:54 user nova-compute[82196]: node.session.auth.username = dIifBHeC
Apr 11 19:38:54 user nova-compute[82196]: node.session.auth.password = ***
Apr 11 19:38:54 user nova-compute[82196]: node.session.auth.username_in = <empty>
Apr 11 19:38:54 user nova-compute[82196]: node.session.auth.password_in = <empty>
Apr 11 19:38:54 user nova-compute[82196]: node.session.auth.chap_algs = MD5
Apr 11 19:38:54 user nova-compute[82196]: node.session.timeo.replacement_timeout = 120
Apr 11 19:38:54 user nova-compute[82196]: node.session.err_timeo.abort_timeout = 15
Apr 11 19:38:54 user nova-compute[82196]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 19:38:54 user nova-compute[82196]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 19:38:54 user nova-compute[82196]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 19:38:54 user nova-compute[82196]: node.session.iscsi.FastAbort = Yes
Apr 11 19:38:54 user nova-compute[82196]: node.session.iscsi.InitialR2T = No
Apr 11 19:38:54 user nova-compute[82196]: node.session.iscsi.ImmediateData = Yes
Apr 11 19:38:54 user nova-compute[82196]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 19:38:54 user nova-compute[82196]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 19:38:54 user nova-compute[82196]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 19:38:54 user nova-compute[82196]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 19:38:54 user nova-compute[82196]: node.session.iscsi.MaxConnections = 1
Apr 11 19:38:54 user nova-compute[82196]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 19:38:54 user nova-compute[82196]: node.session.iscsi.ERL = 0
Apr 11 19:38:54 user nova-compute[82196]: node.session.scan = manual
Apr 11 19:38:54 user nova-compute[82196]: node.session.reopen_max = 0
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].address = 172.16.0.220
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].port = 3260
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].startup = manual
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].tcp.window_size = 524288
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].tcp.type_of_service = 0
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].timeo.logout_timeout = 15
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].timeo.login_timeout = 15
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].timeo.auth_timeout = 45
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].iscsi.DataDigest = None
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].iscsi.IFMarker = No
Apr 11 19:38:54 user nova-compute[82196]: node.conn[0].iscsi.OFMarker = No
Apr 11 19:38:54 user nova-compute[82196]: # END RECORD
Apr 11 19:38:54 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[106c5733-d7e7-4017-9f0f-4db4854b6d2f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d063d9b7-5dd4-43c4-a2cb-7180fa39b01f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIifBHeC {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIifBHeC" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[337bf1ed-8cf1-4cde-ba2b-cd8ca1dd06e9]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dIifBHeC'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d78a82-0d52-4b55-9ac9-42decf11040e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cab847-43a6-4022-b446-e3524bf78e8f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:38:55 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:38:55 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:38:55 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:38:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:38:55 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:38:55 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:38:55 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:38:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.160s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] HCTL ('40', '0', '0', 0) found on session 37 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Scanning host 40 c: 0, t: 0, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb917e9-5045-4d1a-ab70-f854e3ac2cd5]: (4, ('0 0 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Searching for a device in session 37 and hctl ('40', '0', '0', 0) yield: sdi {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIifBHeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.186s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '23733643532346666', 'path': '/dev/sdi'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733643532346666', 'path': '/dev/sdi'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2051818305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2051818305',id=37,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:37:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-uoeaatrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:37:17Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=8c45de50-92bc-467c-9f3d-7e667e1d0bb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "vif_mac": "fa:16:3e:27:09:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "vif_mac": "fa:16:3e:27:09:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:09:60,bridge_name='br-int',has_traffic_filtering=True,id=82ee2878-c477-419c-97ba-9ac4b36dacab,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ee2878-c4') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG nova.objects.instance [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:38:55 user nova-compute[82196]:   <uuid>8c45de50-92bc-467c-9f3d-7e667e1d0bb3</uuid>
Apr 11 19:38:55 user nova-compute[82196]:   <name>instance-00000025</name>
Apr 11 19:38:55 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:38:55 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:38:55 user nova-compute[82196]:   <metadata>
Apr 11 19:38:55 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:38:55 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:38:55 user nova-compute[82196]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2051818305</nova:name>
Apr 11 19:38:55 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:38:54</nova:creationTime>
Apr 11 19:38:55 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:38:55 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:38:55 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:38:55 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:38:55 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:38:55 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:38:55 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:38:55 user nova-compute[82196]:       <nova:owner>
Apr 11 19:38:55 user nova-compute[82196]:         <nova:user uuid="1b3adca432b04d70818a51d1366f5c6d">tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member</nova:user>
Apr 11 19:38:55 user nova-compute[82196]:         <nova:project uuid="eb91586feb3f4a4c84fa8c2183baaf8c">tempest-ServerBootFromVolumeStableRescueTest-863156619</nova:project>
Apr 11 19:38:55 user nova-compute[82196]:       </nova:owner>
Apr 11 19:38:55 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:38:55 user nova-compute[82196]:       <nova:ports>
Apr 11 19:38:55 user nova-compute[82196]:         <nova:port uuid="82ee2878-c477-419c-97ba-9ac4b36dacab">
Apr 11 19:38:55 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 19:38:55 user nova-compute[82196]:         </nova:port>
Apr 11 19:38:55 user nova-compute[82196]:       </nova:ports>
Apr 11 19:38:55 user nova-compute[82196]:     </nova:instance>
Apr 11 19:38:55 user nova-compute[82196]:   </metadata>
Apr 11 19:38:55 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:38:55 user nova-compute[82196]:     <system>
Apr 11 19:38:55 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:38:55 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:38:55 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:38:55 user nova-compute[82196]:       <entry name="serial">8c45de50-92bc-467c-9f3d-7e667e1d0bb3</entry>
Apr 11 19:38:55 user nova-compute[82196]:       <entry name="uuid">8c45de50-92bc-467c-9f3d-7e667e1d0bb3</entry>
Apr 11 19:38:55 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:38:55 user nova-compute[82196]:     </system>
Apr 11 19:38:55 user nova-compute[82196]:   </sysinfo>
Apr 11 19:38:55 user nova-compute[82196]:   <os>
Apr 11 19:38:55 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:38:55 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:38:55 user nova-compute[82196]:   </os>
Apr 11 19:38:55 user nova-compute[82196]:   <features>
Apr 11 19:38:55 user nova-compute[82196]:     <acpi/>
Apr 11 19:38:55 user nova-compute[82196]:     <apic/>
Apr 11 19:38:55 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:38:55 user nova-compute[82196]:   </features>
Apr 11 19:38:55 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:38:55 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:38:55 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:38:55 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:38:55 user nova-compute[82196]:   </clock>
Apr 11 19:38:55 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:38:55 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:38:55 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:38:55 user nova-compute[82196]:   </cpu>
Apr 11 19:38:55 user nova-compute[82196]:   <devices>
Apr 11 19:38:55 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:38:55 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:38:55 user nova-compute[82196]:       <source dev="/dev/sdi"/>
Apr 11 19:38:55 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:38:55 user nova-compute[82196]:       <serial>e13194fc-7f97-44b9-afa8-9380e7358af8</serial>
Apr 11 19:38:55 user nova-compute[82196]:     </disk>
Apr 11 19:38:55 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:38:55 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:38:55 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/disk.rescue"/>
Apr 11 19:38:55 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:38:55 user nova-compute[82196]:       <boot order="1"/>
Apr 11 19:38:55 user nova-compute[82196]:     </disk>
Apr 11 19:38:55 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:38:55 user nova-compute[82196]:       <mac address="fa:16:3e:27:09:60"/>
Apr 11 19:38:55 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:38:55 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:38:55 user nova-compute[82196]:       <target dev="tap82ee2878-c4"/>
Apr 11 19:38:55 user nova-compute[82196]:     </interface>
Apr 11 19:38:55 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:38:55 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/console.log" append="off"/>
Apr 11 19:38:55 user nova-compute[82196]:     </serial>
Apr 11 19:38:55 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:38:55 user nova-compute[82196]:     <video>
Apr 11 19:38:55 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:38:55 user nova-compute[82196]:     </video>
Apr 11 19:38:55 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:38:55 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:38:55 user nova-compute[82196]:     </rng>
Apr 11 19:38:55 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:38:55 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:38:55 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:38:55 user nova-compute[82196]:     </memballoon>
Apr 11 19:38:55 user nova-compute[82196]:   </devices>
Apr 11 19:38:55 user nova-compute[82196]: </domain>
Apr 11 19:38:55 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:38:55 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Instance destroyed successfully.
Apr 11 19:38:55 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:38:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] No VIF found with MAC fa:16:3e:27:09:60, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:38:56 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241921.332124, 781f3398-3d54-49a4-a751-60f4fbc5e49a => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:38:56 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] VM Stopped (Lifecycle Event)
Apr 11 19:38:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-9c18fc82-a335-477d-95df-77b8842f7b20 None None] [instance: 781f3398-3d54-49a4-a751-60f4fbc5e49a] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:38:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-fd1f73b1-de6d-4c32-aa1b-afd993b9fd96 req-1de1fb76-f4b5-4a3b-b55f-5929098a0a82 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fd1f73b1-de6d-4c32-aa1b-afd993b9fd96 req-1de1fb76-f4b5-4a3b-b55f-5929098a0a82 service nova] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fd1f73b1-de6d-4c32-aa1b-afd993b9fd96 req-1de1fb76-f4b5-4a3b-b55f-5929098a0a82 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fd1f73b1-de6d-4c32-aa1b-afd993b9fd96 req-1de1fb76-f4b5-4a3b-b55f-5929098a0a82 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-fd1f73b1-de6d-4c32-aa1b-afd993b9fd96 req-1de1fb76-f4b5-4a3b-b55f-5929098a0a82 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] No waiting events found dispatching network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:38:56 user nova-compute[82196]: WARNING nova.compute.manager [req-fd1f73b1-de6d-4c32-aa1b-afd993b9fd96 req-1de1fb76-f4b5-4a3b-b55f-5929098a0a82 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received unexpected event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab for instance with vm_state active and task_state rescuing.
Apr 11 19:38:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:38:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-1c2a86f5-3f20-4040-aa88-79c22d2b9d3b req-ab1813fa-0376-4043-9f15-978f487a2f46 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:38:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1c2a86f5-3f20-4040-aa88-79c22d2b9d3b req-ab1813fa-0376-4043-9f15-978f487a2f46 service nova] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:38:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1c2a86f5-3f20-4040-aa88-79c22d2b9d3b req-ab1813fa-0376-4043-9f15-978f487a2f46 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:38:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1c2a86f5-3f20-4040-aa88-79c22d2b9d3b req-ab1813fa-0376-4043-9f15-978f487a2f46 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:38:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-1c2a86f5-3f20-4040-aa88-79c22d2b9d3b req-ab1813fa-0376-4043-9f15-978f487a2f46 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] No waiting events found dispatching network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:38:58 user nova-compute[82196]: WARNING nova.compute.manager [req-1c2a86f5-3f20-4040-aa88-79c22d2b9d3b req-ab1813fa-0376-4043-9f15-978f487a2f46 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received unexpected event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab for instance with vm_state active and task_state rescuing.
Apr 11 19:38:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:38:59 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241939.0037143, 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:38:59 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] VM Resumed (Lifecycle Event)
Apr 11 19:38:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4f1180f8-0479-44ca-b22a-af9bfbfe0a80 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:38:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:38:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:38:59 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 19:38:59 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681241939.0049996, 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:38:59 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] VM Started (Lifecycle Event)
Apr 11 19:38:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:38:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:38:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:00 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:39:00 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:39:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:39:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:39:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:31 user nova-compute[82196]: INFO nova.compute.manager [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Terminating instance
Apr 11 19:39:31 user nova-compute[82196]: DEBUG nova.compute.manager [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "afc22926-012a-43fe-99e6-063294c593a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "afc22926-012a-43fe-99e6-063294c593a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "afc22926-012a-43fe-99e6-063294c593a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:32 user nova-compute[82196]: INFO nova.compute.manager [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Terminating instance
Apr 11 19:39:32 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce4b8b24-01de-48cd-8389-7a18b2ae3b37 req-ef2beead-ed87-4cc2-a8c8-f70d025144da service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-vif-unplugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce4b8b24-01de-48cd-8389-7a18b2ae3b37 req-ef2beead-ed87-4cc2-a8c8-f70d025144da service nova] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce4b8b24-01de-48cd-8389-7a18b2ae3b37 req-ef2beead-ed87-4cc2-a8c8-f70d025144da service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce4b8b24-01de-48cd-8389-7a18b2ae3b37 req-ef2beead-ed87-4cc2-a8c8-f70d025144da service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce4b8b24-01de-48cd-8389-7a18b2ae3b37 req-ef2beead-ed87-4cc2-a8c8-f70d025144da service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] No waiting events found dispatching network-vif-unplugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce4b8b24-01de-48cd-8389-7a18b2ae3b37 req-ef2beead-ed87-4cc2-a8c8-f70d025144da service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-vif-unplugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Instance destroyed successfully.
Apr 11 19:39:32 user nova-compute[82196]: DEBUG nova.objects.instance [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lazy-loading 'resources' on Instance uuid fbfa0825-c7c2-4f04-8c9a-102e238c3816 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:33:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1228547187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1228547187',id=30,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkkJTr5YuxkpX+fjT2biW1YPqt/B9xeGSfz5eI9idL14cBKKQVv2aWXZgrf6S4OtstSLTh3Ew1HBAxse2BI4QjcaST8i9go9QpbAcGCdV8ckJbY2dhHYp7Im1s1H/H33w==',key_name='tempest-keypair-1296340783',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d8b189667e34931aa36149620a036e1',ramdisk_id='',reservation_id='r-jqpowijw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-427928846',owner_user_name='tempest-AttachVolumeShelveTestJSON-427928846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0558ba5a2b04d36ba2f2411090cc4e4',uuid=fbfa0825-c7c2-4f04-8c9a-102e238c3816,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converting VIF {"id": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "address": "fa:16:3e:7b:46:50", "network": {"id": "0fffcabf-f83f-41a3-b4e9-c67b67b4f814", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-540855920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8b189667e34931aa36149620a036e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be0dfa4-d8", "ovs_interfaceid": "0be0dfa4-d8ad-4d32-83ab-a090c0f77f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG os_vif [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0be0dfa4-d8, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: afc22926-012a-43fe-99e6-063294c593a6] Instance destroyed successfully.
Apr 11 19:39:33 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lazy-loading 'resources' on Instance uuid afc22926-012a-43fe-99e6-063294c593a6 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:33 user nova-compute[82196]: INFO os_vif [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:46:50,bridge_name='br-int',has_traffic_filtering=True,id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34,network=Network(0fffcabf-f83f-41a3-b4e9-c67b67b4f814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be0dfa4-d8')
Apr 11 19:39:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Deleting instance files /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816_del
Apr 11 19:39:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Deletion of /opt/stack/data/nova/instances/fbfa0825-c7c2-4f04-8c9a-102e238c3816_del complete
Apr 11 19:39:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-96679831',display_name='tempest-TestVolumeBootPattern-volume-backed-server-96679831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-96679831',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:35:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-nrrck3pw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:35:06Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=afc22926-012a-43fe-99e6-063294c593a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8491f5dc-f77b-491b-b24f-19791271647d", "address": "fa:16:3e:db:3f:6a", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491f5dc-f7", "ovs_interfaceid": "8491f5dc-f77b-491b-b24f-19791271647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "8491f5dc-f77b-491b-b24f-19791271647d", "address": "fa:16:3e:db:3f:6a", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491f5dc-f7", "ovs_interfaceid": "8491f5dc-f77b-491b-b24f-19791271647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3f:6a,bridge_name='br-int',has_traffic_filtering=True,id=8491f5dc-f77b-491b-b24f-19791271647d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491f5dc-f7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_vif [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3f:6a,bridge_name='br-int',has_traffic_filtering=True,id=8491f5dc-f77b-491b-b24f-19791271647d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491f5dc-f7') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8491f5dc-f7, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:39:33 user nova-compute[82196]: INFO os_vif [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3f:6a,bridge_name='br-int',has_traffic_filtering=True,id=8491f5dc-f77b-491b-b24f-19791271647d,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491f5dc-f7')
Apr 11 19:39:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adnVFifR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:39:33 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0515f58a-4c1c-4381-a8ca-5a94c21a45a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:39:33 user nova-compute[82196]: No targets found.
Apr 11 19:39:33 user nova-compute[82196]: iSNS:
Apr 11 19:39:33 user nova-compute[82196]: No targets found.
Apr 11 19:39:33 user nova-compute[82196]: STATIC:
Apr 11 19:39:33 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574
Apr 11 19:39:33 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:39:33 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:39:33 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:39:33 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:39:33 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:39:33 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:39:33 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:39:33 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:39:33 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e
Apr 11 19:39:33 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:39:33 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:39:33 user nova-compute[82196]: FIRMWARE:
Apr 11 19:39:33 user nova-compute[82196]: No targets found.
Apr 11 19:39:33 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:39:33 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:39:33 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aa84fc-7267-49a0-93c8-479a0c6c98ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:33 user nova-compute[82196]: INFO nova.compute.manager [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[637a183d-51e0-4edf-a8a3-2d9f0eb79800]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:39:33 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:39:33 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:39:33 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:39:33 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:39:33 user nova-compute[82196]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 (non-flash)
Apr 11 19:39:33 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:39:33 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:39:33 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927c149b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574'): ({'sdc'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Removing single pathed devices sdc {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[60403924-7641-479b-bdd4-94c079a6f22f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6258f83-f6fa-4de1-a8f1-bd9819325f26]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flushing IO for device /dev/sdc {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bda5ae-4bd8-454b-963d-eac753ed953c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a73054-8099-4fc5-a682-b5387bd550de]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO73cca3e4-7eb846874438d60d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_73cca3e4', '/dev/disk/by-id/scsi-23765623834363837') {{(pid=91954) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04a2b4e-64d2-4760-83d2-28be3eb34451]: (4, None) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f916a42-164b-49e2-bbec-4a0e2b141c55]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[739a4c04-5fa4-4654-bf99-385db9d49efe]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574, portal: 172.16.0.220,3260]
Apr 11 19:39:33 user nova-compute[82196]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574, portal: 172.16.0.220,3260] successful.
Apr 11 19:39:33 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa96911-0869-4a41-97fe-ebf8f5bf1574 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8435bae-ef2a-449b-9f3f-4e518211145d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== disconnect_volume: return (417ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:39:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Deleting instance files /opt/stack/data/nova/instances/afc22926-012a-43fe-99e6-063294c593a6_del
Apr 11 19:39:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Deletion of /opt/stack/data/nova/instances/afc22926-012a-43fe-99e6-063294c593a6_del complete
Apr 11 19:39:33 user nova-compute[82196]: INFO nova.compute.manager [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Took 1.39 seconds to destroy the instance on the hypervisor.
Apr 11 19:39:33 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: afc22926-012a-43fe-99e6-063294c593a6] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: afc22926-012a-43fe-99e6-063294c593a6] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:33 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:39:34 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Took 0.88 seconds to deallocate network for instance.
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2b842c1e-3b19-4ccb-804c-1c1f692a1fd0 req-b90b05f2-1df7-43da-90ba-653ac8bd1362 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-vif-deleted-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:39:34 user nova-compute[82196]: INFO nova.compute.manager [req-2b842c1e-3b19-4ccb-804c-1c1f692a1fd0 req-b90b05f2-1df7-43da-90ba-653ac8bd1362 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Neutron deleted interface 0be0dfa4-d8ad-4d32-83ab-a090c0f77f34; detaching it from the instance and deleting it from the info cache
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.network.neutron [req-2b842c1e-3b19-4ccb-804c-1c1f692a1fd0 req-b90b05f2-1df7-43da-90ba-653ac8bd1362 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2b842c1e-3b19-4ccb-804c-1c1f692a1fd0 req-b90b05f2-1df7-43da-90ba-653ac8bd1362 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Detach interface failed, port_id=0be0dfa4-d8ad-4d32-83ab-a090c0f77f34, reason: Instance fbfa0825-c7c2-4f04-8c9a-102e238c3816 could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:34 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Deleted allocations for instance fbfa0825-c7c2-4f04-8c9a-102e238c3816
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-33963c79-b3c1-4569-aacf-55d1367da661 tempest-AttachVolumeShelveTestJSON-427928846 tempest-AttachVolumeShelveTestJSON-427928846-project-member] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.582s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received event network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Acquiring lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "fbfa0825-c7c2-4f04-8c9a-102e238c3816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] No waiting events found dispatching network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:39:34 user nova-compute[82196]: WARNING nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Received unexpected event network-vif-plugged-0be0dfa4-d8ad-4d32-83ab-a090c0f77f34 for instance with vm_state deleted and task_state None.
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received event network-vif-unplugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Acquiring lock "afc22926-012a-43fe-99e6-063294c593a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] No waiting events found dispatching network-vif-unplugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received event network-vif-unplugged-8491f5dc-f77b-491b-b24f-19791271647d for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received event network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Acquiring lock "afc22926-012a-43fe-99e6-063294c593a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] No waiting events found dispatching network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:39:34 user nova-compute[82196]: WARNING nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received unexpected event network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d for instance with vm_state active and task_state deleting.
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received event network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Acquiring lock "afc22926-012a-43fe-99e6-063294c593a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] No waiting events found dispatching network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:39:34 user nova-compute[82196]: WARNING nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received unexpected event network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d for instance with vm_state active and task_state deleting.
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received event network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Acquiring lock "afc22926-012a-43fe-99e6-063294c593a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] No waiting events found dispatching network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:39:34 user nova-compute[82196]: WARNING nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received unexpected event network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d for instance with vm_state active and task_state deleting.
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received event network-vif-unplugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Acquiring lock "afc22926-012a-43fe-99e6-063294c593a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] No waiting events found dispatching network-vif-unplugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received event network-vif-unplugged-8491f5dc-f77b-491b-b24f-19791271647d for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received event network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Acquiring lock "afc22926-012a-43fe-99e6-063294c593a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] Lock "afc22926-012a-43fe-99e6-063294c593a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] No waiting events found dispatching network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:39:34 user nova-compute[82196]: WARNING nova.compute.manager [req-2bb9f1b9-8294-4cf7-a362-5294efa6c0cf req-4d0e5d20-0590-42cc-af1f-326b381dd1b2 service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received unexpected event network-vif-plugged-8491f5dc-f77b-491b-b24f-19791271647d for instance with vm_state active and task_state deleting.
Apr 11 19:39:34 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: afc22926-012a-43fe-99e6-063294c593a6] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:39:34 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: afc22926-012a-43fe-99e6-063294c593a6] Took 1.21 seconds to deallocate network for instance.
Apr 11 19:39:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:35 user nova-compute[82196]: INFO nova.compute.manager [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Took 0.78 seconds to detach 1 volumes for instance.
Apr 11 19:39:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: afc22926-012a-43fe-99e6-063294c593a6] Deleting volume: cfa96911-0869-4a41-97fe-ebf8f5bf1574 {{(pid=82196) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 19:39:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:35 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:39:35 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:39:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:36 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Deleted allocations for instance afc22926-012a-43fe-99e6-063294c593a6
Apr 11 19:39:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3906b2db-85d6-4e45-981d-baf9b544d452 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "afc22926-012a-43fe-99e6-063294c593a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.917s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-47164197-2937-448f-a049-5942be0a8290 req-cbbbfee1-b62b-4eab-bf7e-f245385130dc service nova] [instance: afc22926-012a-43fe-99e6-063294c593a6] Received event network-vif-deleted-8491f5dc-f77b-491b-b24f-19791271647d {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:39:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:44 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:39:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:39:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:39:47 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:39:47 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:39:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-b079367a-558e-4920-ad8d-972a8065260c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:39:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-b079367a-558e-4920-ad8d-972a8065260c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:39:47 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: b079367a-558e-4920-ad8d-972a8065260c] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:39:47 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241972.9487727, fbfa0825-c7c2-4f04-8c9a-102e238c3816 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:39:47 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] VM Stopped (Lifecycle Event)
Apr 11 19:39:47 user nova-compute[82196]: DEBUG nova.compute.manager [None req-38a849cd-f42d-4049-945b-15ce01145715 None None] [instance: fbfa0825-c7c2-4f04-8c9a-102e238c3816] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:39:47 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681241972.9833214, afc22926-012a-43fe-99e6-063294c593a6 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:39:47 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: afc22926-012a-43fe-99e6-063294c593a6] VM Stopped (Lifecycle Event)
Apr 11 19:39:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-af2ec0a2-c2cc-456b-a862-b4453e42414c None None] [instance: afc22926-012a-43fe-99e6-063294c593a6] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:39:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:39:48 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: b079367a-558e-4920-ad8d-972a8065260c] Updating instance_info_cache with network_info: [{"id": "54168103-37cf-4abe-a4e5-bac3eeeca578", "address": "fa:16:3e:29:d3:5a", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54168103-37", "ovs_interfaceid": "54168103-37cf-4abe-a4e5-bac3eeeca578", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:39:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-b079367a-558e-4920-ad8d-972a8065260c" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:39:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: b079367a-558e-4920-ad8d-972a8065260c] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:39:48 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:39:49 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:39:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:39:55 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:39:55 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8005MB free_disk=26.106395721435547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance b079367a-558e-4920-ad8d-972a8065260c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 647674d8-af53-405a-8116-4b7a01549bdf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bf0a75f5-2f44-4687-af12-046f6761fee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:39:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:39:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:39:59 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:39:59 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:39:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:40:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:01 user nova-compute[82196]: INFO nova.compute.manager [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Unshelving
Apr 11 19:40:02 user nova-compute[82196]: INFO nova.virt.block_device [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Booting with volume 199762db-3930-4f05-a4da-15dee19e5418 at /dev/vda
Apr 11 19:40:02 user nova-compute[82196]: DEBUG os_brick.utils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[17613cba-6ffc-406b-916d-93ed68fb12d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4d243d-b357-4b5f-8e61-e31a69420357]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[742b15d4-dadc-4291-b677-6846227c84f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b780db5-80aa-4a9a-b60a-e486482ed5d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:40:02 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:40:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faff8de-c2d4-42e2-8aba-6cd3c8f8c9e1]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG os_brick.utils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:40:02 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updating existing volume attachment record: 53a8d11a-f1a3-4d45-9492-e5dfb3e788ed {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:40:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:06 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lazy-loading 'pci_requests' on Instance uuid d42dc0ea-4631-44be-8b58-09877280ba2e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:06 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lazy-loading 'numa_topology' on Instance uuid d42dc0ea-4631-44be-8b58-09877280ba2e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:06 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:40:06 user nova-compute[82196]: INFO nova.compute.claims [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Claim successful on node user
Apr 11 19:40:07 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:40:07 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:40:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:07 user nova-compute[82196]: INFO nova.network.neutron [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updating port fd43e974-64b6-4605-83cb-11b9cfe58341 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquired lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5006 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.compute.manager [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-changed-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.compute.manager [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Refreshing instance network info cache due to event network-changed-fd43e974-64b6-4605-83cb-11b9cfe58341. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] Acquiring lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.network.neutron [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updating instance_info_cache with network_info: [{"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Releasing lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:40:08 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Creating image(s)
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Ensure instance console log exists: /opt/stack/data/nova/instances/d42dc0ea-4631-44be-8b58-09877280ba2e/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Start _get_guest_xml network_info=[{"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arNXGbxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd42dc0ea-4631-44be-8b58-09877280ba2e', 'attached_at': '', 'detached_at': '', 'volume_id': '199762db-3930-4f05-a4da-15dee19e5418', 'serial': '199762db-3930-4f05-a4da-15dee19e5418'}, 'attachment_id': '53a8d11a-f1a3-4d45-9492-e5dfb3e788ed', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] Acquired lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.network.neutron [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Refreshing network info cache for port fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:40:08 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:40:08 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lazy-loading 'vcpu_model' on Instance uuid d42dc0ea-4631-44be-8b58-09877280ba2e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arNXGbxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:40:08 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:40:08 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:40:08 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1153c51-8c4e-46fb-88a7-52966ebcf3c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:40:08 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c77d052-ec7a-4fd9-abe6-7936339f3e20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418] added
Apr 11 19:40:08 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ccd812-005b-484b-a095-e10b2f207744]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0005c38-ae47-47cc-a0cd-3ba1654f0b3e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v arNXGbxM {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v arNXGbxM" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b749c98-36f2-4015-a251-75a1f1bd131d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'arNXGbxM'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fc61ca-a379-436a-9d7e-570bd4752ecc]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e29d9e-c041-4339-bda7-d11237f9629a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:08 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:08 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:40:08 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:08 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:08 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:40:08 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[85542563-3f64-4233-ab3b-4150b10556a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260]
Apr 11 19:40:08 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260] successful.
Apr 11 19:40:08 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[31df6086-1d03-4fc9-a66c-31b678769ba2]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ced3674-9df2-49ff-9830-244420966e57]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:08 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:08 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:40:08 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:40:08 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:08 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:08 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:40:08 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:40:08 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c80b66-1601-4cd5-86c0-56e08aad585a]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:40:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arNXGbxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG nova.network.neutron [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updated VIF entry in instance network info cache for port fd43e974-64b6-4605-83cb-11b9cfe58341. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG nova.network.neutron [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updating instance_info_cache with network_info: [{"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4174c5f3-51ee-4936-a695-65d28915759b req-3dabe175-7233-435b-b774-dfb707250f6c service nova] Releasing lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26166656432353939', 'path': '/dev/sdc'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166656432353939', 'path': '/dev/sdc'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-63091414',display_name='tempest-TestShelveInstance-server-63091414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-63091414',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1765937682',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:36:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7b9baa081ca455ea6931b7801c805b8',ramdisk_id='',reservation_id='r-90gk500j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1694566228',owner_user_name='tempest-TestShelveInstance-1694566228-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:40:02Z,user_data=None,user_id='68fcdcd3af164195bf0c7da3b8dfecb7',uuid=d42dc0ea-4631-44be-8b58-09877280ba2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Converting VIF {"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG nova.objects.instance [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lazy-loading 'pci_devices' on Instance uuid d42dc0ea-4631-44be-8b58-09877280ba2e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG nova.compute.manager [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-changed-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG nova.compute.manager [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Refreshing instance network info cache due to event network-changed-c662b1b3-b2b3-4502-81af-9afdf3e591dc. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] Acquiring lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] Acquired lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:40:09 user nova-compute[82196]: DEBUG nova.network.neutron [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Refreshing network info cache for port c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:40:10 user nova-compute[82196]:   <uuid>d42dc0ea-4631-44be-8b58-09877280ba2e</uuid>
Apr 11 19:40:10 user nova-compute[82196]:   <name>instance-00000023</name>
Apr 11 19:40:10 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:40:10 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:40:10 user nova-compute[82196]:   <metadata>
Apr 11 19:40:10 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:40:10 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:40:10 user nova-compute[82196]:       <nova:name>tempest-TestShelveInstance-server-63091414</nova:name>
Apr 11 19:40:10 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:40:08</nova:creationTime>
Apr 11 19:40:10 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:40:10 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:40:10 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:40:10 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:40:10 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:40:10 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:40:10 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:40:10 user nova-compute[82196]:       <nova:owner>
Apr 11 19:40:10 user nova-compute[82196]:         <nova:user uuid="68fcdcd3af164195bf0c7da3b8dfecb7">tempest-TestShelveInstance-1694566228-project-member</nova:user>
Apr 11 19:40:10 user nova-compute[82196]:         <nova:project uuid="c7b9baa081ca455ea6931b7801c805b8">tempest-TestShelveInstance-1694566228</nova:project>
Apr 11 19:40:10 user nova-compute[82196]:       </nova:owner>
Apr 11 19:40:10 user nova-compute[82196]:       <nova:ports>
Apr 11 19:40:10 user nova-compute[82196]:         <nova:port uuid="fd43e974-64b6-4605-83cb-11b9cfe58341">
Apr 11 19:40:10 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 19:40:10 user nova-compute[82196]:         </nova:port>
Apr 11 19:40:10 user nova-compute[82196]:       </nova:ports>
Apr 11 19:40:10 user nova-compute[82196]:     </nova:instance>
Apr 11 19:40:10 user nova-compute[82196]:   </metadata>
Apr 11 19:40:10 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:40:10 user nova-compute[82196]:     <system>
Apr 11 19:40:10 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:40:10 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:40:10 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:40:10 user nova-compute[82196]:       <entry name="serial">d42dc0ea-4631-44be-8b58-09877280ba2e</entry>
Apr 11 19:40:10 user nova-compute[82196]:       <entry name="uuid">d42dc0ea-4631-44be-8b58-09877280ba2e</entry>
Apr 11 19:40:10 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:40:10 user nova-compute[82196]:     </system>
Apr 11 19:40:10 user nova-compute[82196]:   </sysinfo>
Apr 11 19:40:10 user nova-compute[82196]:   <os>
Apr 11 19:40:10 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:40:10 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:40:10 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:40:10 user nova-compute[82196]:   </os>
Apr 11 19:40:10 user nova-compute[82196]:   <features>
Apr 11 19:40:10 user nova-compute[82196]:     <acpi/>
Apr 11 19:40:10 user nova-compute[82196]:     <apic/>
Apr 11 19:40:10 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:40:10 user nova-compute[82196]:   </features>
Apr 11 19:40:10 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:40:10 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:40:10 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:40:10 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:40:10 user nova-compute[82196]:   </clock>
Apr 11 19:40:10 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:40:10 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:40:10 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:40:10 user nova-compute[82196]:   </cpu>
Apr 11 19:40:10 user nova-compute[82196]:   <devices>
Apr 11 19:40:10 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:40:10 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:40:10 user nova-compute[82196]:       <source dev="/dev/sdc"/>
Apr 11 19:40:10 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:40:10 user nova-compute[82196]:       <serial>199762db-3930-4f05-a4da-15dee19e5418</serial>
Apr 11 19:40:10 user nova-compute[82196]:     </disk>
Apr 11 19:40:10 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:40:10 user nova-compute[82196]:       <mac address="fa:16:3e:a4:fd:c3"/>
Apr 11 19:40:10 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:40:10 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:40:10 user nova-compute[82196]:       <target dev="tapfd43e974-64"/>
Apr 11 19:40:10 user nova-compute[82196]:     </interface>
Apr 11 19:40:10 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:40:10 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/d42dc0ea-4631-44be-8b58-09877280ba2e/console.log" append="off"/>
Apr 11 19:40:10 user nova-compute[82196]:     </serial>
Apr 11 19:40:10 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:40:10 user nova-compute[82196]:     <video>
Apr 11 19:40:10 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:40:10 user nova-compute[82196]:     </video>
Apr 11 19:40:10 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:40:10 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:40:10 user nova-compute[82196]:     </rng>
Apr 11 19:40:10 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:40:10 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:40:10 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:40:10 user nova-compute[82196]:     </memballoon>
Apr 11 19:40:10 user nova-compute[82196]:   </devices>
Apr 11 19:40:10 user nova-compute[82196]: </domain>
Apr 11 19:40:10 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-63091414',display_name='tempest-TestShelveInstance-server-63091414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-63091414',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1765937682',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:36:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7b9baa081ca455ea6931b7801c805b8',ramdisk_id='',reservation_id='r-90gk500j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1694566228',owner_user_name='tempest-TestShelveInstance-1694566228-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:40:02Z,user_data=None,user_id='68fcdcd3af164195bf0c7da3b8dfecb7',uuid=d42dc0ea-4631-44be-8b58-09877280ba2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Converting VIF {"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG os_vif [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd43e974-64, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd43e974-64, col_values=(('external_ids', {'iface-id': 'fd43e974-64b6-4605-83cb-11b9cfe58341', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:fd:c3', 'vm-uuid': 'd42dc0ea-4631-44be-8b58-09877280ba2e'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:10 user nova-compute[82196]: INFO os_vif [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64')
Apr 11 19:40:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] No VIF found with MAC fa:16:3e:a4:fd:c3, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updated VIF entry in instance network info cache for port c662b1b3-b2b3-4502-81af-9afdf3e591dc. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updating instance_info_cache with network_info: [{"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f281f65f-ffbe-4aa6-a149-d1e33b4578ad req-4fc151b7-b38e-4674-b13b-4dcdc615b599 service nova] Releasing lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG nova.objects.instance [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'flavor' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:10 user nova-compute[82196]: INFO nova.compute.manager [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Attaching volume 6cb60e75-74d9-4e1f-a22e-40a36780b21b to /dev/vdb
Apr 11 19:40:10 user nova-compute[82196]: DEBUG os_brick.utils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8775f8-db49-4c93-ab87-15ca3ed7bada]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[427831a9-05da-4ef4-aa76-a3b0bdb18bce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6029ffa-92f7-4840-9625-1a34bca3f7bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c38b8b-fd93-4d38-ad19-8ee2bfade6f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:40:10 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:40:10 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0719d526-5357-4b1e-9249-9b2b7d82793c]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG os_brick.utils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:40:10 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updating existing volume attachment record: 02ae37f6-860d-44be-866f-4831e124149f {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:40:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-0ecb5a31-9675-4db2-99f5-a961f07c7944 req-438f692d-42c4-421a-8674-63b9e7fc87a2 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0ecb5a31-9675-4db2-99f5-a961f07c7944 req-438f692d-42c4-421a-8674-63b9e7fc87a2 service nova] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0ecb5a31-9675-4db2-99f5-a961f07c7944 req-438f692d-42c4-421a-8674-63b9e7fc87a2 service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0ecb5a31-9675-4db2-99f5-a961f07c7944 req-438f692d-42c4-421a-8674-63b9e7fc87a2 service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-0ecb5a31-9675-4db2-99f5-a961f07c7944 req-438f692d-42c4-421a-8674-63b9e7fc87a2 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] No waiting events found dispatching network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:11 user nova-compute[82196]: WARNING nova.compute.manager [req-0ecb5a31-9675-4db2-99f5-a961f07c7944 req-438f692d-42c4-421a-8674-63b9e7fc87a2 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received unexpected event network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 19:40:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:40:13 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:40:13 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242013.5632188, d42dc0ea-4631-44be-8b58-09877280ba2e => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:40:13 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] VM Resumed (Lifecycle Event)
Apr 11 19:40:13 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Instance spawned successfully.
Apr 11 19:40:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:40:13 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:40:13 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242013.5692234, d42dc0ea-4631-44be-8b58-09877280ba2e => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:40:13 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] VM Started (Lifecycle Event)
Apr 11 19:40:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:40:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-7d26910b-fb60-4f3d-90c9-66c309da75e8 req-f98a0c9f-ffe5-49c9-9496-c4062e67e1d1 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7d26910b-fb60-4f3d-90c9-66c309da75e8 req-f98a0c9f-ffe5-49c9-9496-c4062e67e1d1 service nova] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7d26910b-fb60-4f3d-90c9-66c309da75e8 req-f98a0c9f-ffe5-49c9-9496-c4062e67e1d1 service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7d26910b-fb60-4f3d-90c9-66c309da75e8 req-f98a0c9f-ffe5-49c9-9496-c4062e67e1d1 service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-7d26910b-fb60-4f3d-90c9-66c309da75e8 req-f98a0c9f-ffe5-49c9-9496-c4062e67e1d1 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] No waiting events found dispatching network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:13 user nova-compute[82196]: WARNING nova.compute.manager [req-7d26910b-fb60-4f3d-90c9-66c309da75e8 req-f98a0c9f-ffe5-49c9-9496-c4062e67e1d1 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received unexpected event network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 19:40:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-3e91c02e-54c8-4b31-a6e9-b590c24851d6 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.719s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnVDWZAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:40:15 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:40:15 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:40:15 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0b4bee-d695-44c0-a96d-062c82e4882e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:40:15 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0273689d-61fe-4db7-bbad-ab2aa186bfdc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b] added
Apr 11 19:40:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1f3cc0-0386-41e1-b2f4-b4ac06dc9c94]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d356e813-fd2d-422f-bf10-de443951dc72]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EnVDWZAq {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EnVDWZAq" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f72b526-20d5-4607-b038-ba91dd2ed6ad]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EnVDWZAq'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7b8e88-5f9f-45d6-8652-3d38d5a86d11]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e81a1df-afea-4be3-8170-8f6903b2f747]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:40:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:40:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99c6709-51d9-4e9c-8510-bfe332658783]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b, portal: 172.16.0.220,3260]
Apr 11 19:40:15 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b, portal: 172.16.0.220,3260] successful.
Apr 11 19:40:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d3a58f-dc14-45d1-b641-6271bcefb787]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2094f69-93f5-4401-b406-0ab8e9eee334]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:40:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:40:15 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:40:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1666efe0-1101-4cd0-aca4-b53f344ba7d9]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: None {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:16 user nova-compute[82196]: INFO nova.compute.manager [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Terminating instance
Apr 11 19:40:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnVDWZAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26161376532636234', 'path': '/dev/sde'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161376532636234', 'path': '/dev/sde'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG nova.objects.instance [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'flavor' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:40:16 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:40:16 user nova-compute[82196]:   <source dev="/dev/sde"/>
Apr 11 19:40:16 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:40:16 user nova-compute[82196]:   <serial>6cb60e75-74d9-4e1f-a22e-40a36780b21b</serial>
Apr 11 19:40:16 user nova-compute[82196]: </disk>
Apr 11 19:40:16 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG nova.compute.manager [req-465ec605-f64c-457a-8470-b055594ea208 req-454f193a-7d4a-4e50-93e7-8899e867dd2f service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-unplugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-465ec605-f64c-457a-8470-b055594ea208 req-454f193a-7d4a-4e50-93e7-8899e867dd2f service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-465ec605-f64c-457a-8470-b055594ea208 req-454f193a-7d4a-4e50-93e7-8899e867dd2f service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-465ec605-f64c-457a-8470-b055594ea208 req-454f193a-7d4a-4e50-93e7-8899e867dd2f service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG nova.compute.manager [req-465ec605-f64c-457a-8470-b055594ea208 req-454f193a-7d4a-4e50-93e7-8899e867dd2f service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-unplugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:16 user nova-compute[82196]: DEBUG nova.compute.manager [req-465ec605-f64c-457a-8470-b055594ea208 req-454f193a-7d4a-4e50-93e7-8899e867dd2f service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-unplugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No VIF found with MAC fa:16:3e:16:43:8c, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5a15d0ea-d867-47e6-9fb1-1b49575b40c4 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.530s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:17 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Instance destroyed successfully.
Apr 11 19:40:17 user nova-compute[82196]: DEBUG nova.objects.instance [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'resources' on Instance uuid 647674d8-af53-405a-8116-4b7a01549bdf {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-505347267',display_name='tempest-ServerActionsTestJSON-server-1599172202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-505347267',id=21,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:37:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-lxpjy0l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:37:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=647674d8-af53-405a-8116-4b7a01549bdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "address": "fa:16:3e:7a:ec:62", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e4888a-16", "ovs_interfaceid": "e4e4888a-168a-4fe8-a43e-ee683b50a39a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_vif [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4e4888a-16, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:40:17 user nova-compute[82196]: INFO os_vif [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:62,bridge_name='br-int',has_traffic_filtering=True,id=e4e4888a-168a-4fe8-a43e-ee683b50a39a,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e4888a-16')
Apr 11 19:40:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlutpRPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:40:17 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5dac5a-c3c1-4390-b677-3ddd2635eed4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:40:17 user nova-compute[82196]: No targets found.
Apr 11 19:40:17 user nova-compute[82196]: iSNS:
Apr 11 19:40:17 user nova-compute[82196]: No targets found.
Apr 11 19:40:17 user nova-compute[82196]: STATIC:
Apr 11 19:40:17 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:40:17 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:40:17 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:40:17 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:40:17 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:40:17 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:40:17 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e
Apr 11 19:40:17 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:40:17 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:40:17 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b
Apr 11 19:40:17 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:40:17 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:40:17 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418
Apr 11 19:40:17 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:40:17 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:40:17 user nova-compute[82196]: FIRMWARE:
Apr 11 19:40:17 user nova-compute[82196]: No targets found.
Apr 11 19:40:17 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:40:17 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:40:17 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce122df-5df9-4f82-b6ea-10073128ca75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6d3883-3285-4a26-8ad7-d090ca323d19]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:17 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:17 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:40:17 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:40:17 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:40:17 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:17 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:17 user nova-compute[82196]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e (non-flash)
Apr 11 19:40:17 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:40:17 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:40:17 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9281bf2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e'): ({'sdd'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Removing single pathed devices sdd {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[622fcd00-b84b-4cbe-a400-3bc9ddc47ae1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3252f5f6-2fa0-4add-a4f0-45cf7bcd91dd]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flushing IO for device /dev/sdd {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75530f1-0f24-4168-b911-7d4708ad1afa]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b29c1-2060-41ae-80e2-3a103ad63dac]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[446f621a-5d7d-45d2-9527-fdc9e53a8557]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1e8bd4-0d7a-44f0-8649-72c8f74918bf]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260]
Apr 11 19:40:17 user nova-compute[82196]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e, portal: 172.16.0.220,3260] successful.
Apr 11 19:40:17 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f069dda-26af-4766-b53f-0a831de5011e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6084762c-983d-4f6f-ba3c-18357e7bd2ff]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== disconnect_volume: return (323ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:40:17 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Deleting instance files /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf_del
Apr 11 19:40:17 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Deletion of /opt/stack/data/nova/instances/647674d8-af53-405a-8116-4b7a01549bdf_del complete
Apr 11 19:40:17 user nova-compute[82196]: INFO nova.compute.manager [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Took 1.45 seconds to destroy the instance on the hypervisor.
Apr 11 19:40:17 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:40:17 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:40:18 user nova-compute[82196]: INFO nova.compute.manager [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Rescuing
Apr 11 19:40:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:40:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquired lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:40:18 user nova-compute[82196]: DEBUG nova.network.neutron [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:40:18 user nova-compute[82196]: DEBUG nova.compute.manager [req-ed2b56ab-b965-4975-8ff7-4d49180fbae0 req-0d895df8-567e-4619-94fb-f69ba67f3de6 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ed2b56ab-b965-4975-8ff7-4d49180fbae0 req-0d895df8-567e-4619-94fb-f69ba67f3de6 service nova] Acquiring lock "647674d8-af53-405a-8116-4b7a01549bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ed2b56ab-b965-4975-8ff7-4d49180fbae0 req-0d895df8-567e-4619-94fb-f69ba67f3de6 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ed2b56ab-b965-4975-8ff7-4d49180fbae0 req-0d895df8-567e-4619-94fb-f69ba67f3de6 service nova] Lock "647674d8-af53-405a-8116-4b7a01549bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:18 user nova-compute[82196]: DEBUG nova.compute.manager [req-ed2b56ab-b965-4975-8ff7-4d49180fbae0 req-0d895df8-567e-4619-94fb-f69ba67f3de6 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] No waiting events found dispatching network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:18 user nova-compute[82196]: WARNING nova.compute.manager [req-ed2b56ab-b965-4975-8ff7-4d49180fbae0 req-0d895df8-567e-4619-94fb-f69ba67f3de6 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received unexpected event network-vif-plugged-e4e4888a-168a-4fe8-a43e-ee683b50a39a for instance with vm_state active and task_state deleting.
Apr 11 19:40:18 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:40:18 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Took 0.95 seconds to deallocate network for instance.
Apr 11 19:40:18 user nova-compute[82196]: DEBUG nova.compute.manager [req-0d76927d-18b3-4e0c-98d4-ddb5b698629a req-0f235bba-5351-4b23-99ad-77d7fe241fb4 service nova] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Received event network-vif-deleted-e4e4888a-168a-4fe8-a43e-ee683b50a39a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:19 user nova-compute[82196]: DEBUG nova.network.neutron [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updating instance_info_cache with network_info: [{"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:40:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Releasing lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:40:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:19 user nova-compute[82196]: INFO nova.compute.manager [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Took 0.95 seconds to detach 1 volumes for instance.
Apr 11 19:40:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:20 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Deleted allocations for instance 647674d8-af53-405a-8116-4b7a01549bdf
Apr 11 19:40:20 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Instance destroyed successfully.
Apr 11 19:40:20 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Attempting rescue
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82196) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Instance directory exists: not creating {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 19:40:20 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Creating image(s)
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "/opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "/opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fb895d5a-e0bf-4334-92ae-1b777141343a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "647674d8-af53-405a-8116-4b7a01549bdf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.941s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.rescue {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.rescue" returned: 0 in 0.050s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'migration_context' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Start _get_guest_xml network_info=[{"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "vif_mac": "fa:16:3e:16:43:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'resources' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'numa_topology' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:20 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:40:20 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1910984367',display_name='tempest-ServerRescueNegativeTestJSON-server-1910984367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1910984367',id=38,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOg6Hf94pVltDkkNWWRUkyDdm5FkHOFas15WTV4ELfursaPozu4TbpoIUk0HP0VHxjYdcQgsc8wfNgH6fYZasAgDxzJ8ujV0YM5uYIVaN2C0LA5O+gHU06Xkv+AxumfVcw==',key_name='tempest-keypair-1079379697',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:38:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8e3a291c54b49db8e12a88ba41865e3',ramdisk_id='',reservation_id='r-m984i7hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1429831687',owner_user_name='tempest-ServerRescueNegativeTestJSON-1429831687-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:38:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba7f82b529e74d99838b6264b94d823b',uuid=bf0a75f5-2f44-4687-af12-046f6761fee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "vif_mac": "fa:16:3e:16:43:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converting VIF {"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "vif_mac": "fa:16:3e:16:43:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:43:8c,bridge_name='br-int',has_traffic_filtering=True,id=c662b1b3-b2b3-4502-81af-9afdf3e591dc,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc662b1b3-b2') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'pci_devices' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:40:20 user nova-compute[82196]:   <uuid>bf0a75f5-2f44-4687-af12-046f6761fee2</uuid>
Apr 11 19:40:20 user nova-compute[82196]:   <name>instance-00000026</name>
Apr 11 19:40:20 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:40:20 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:40:20 user nova-compute[82196]:   <metadata>
Apr 11 19:40:20 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:40:20 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:40:20 user nova-compute[82196]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1910984367</nova:name>
Apr 11 19:40:20 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:40:20</nova:creationTime>
Apr 11 19:40:20 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:40:20 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:40:20 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:40:20 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:40:20 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:40:20 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:40:20 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:40:20 user nova-compute[82196]:       <nova:owner>
Apr 11 19:40:20 user nova-compute[82196]:         <nova:user uuid="ba7f82b529e74d99838b6264b94d823b">tempest-ServerRescueNegativeTestJSON-1429831687-project-member</nova:user>
Apr 11 19:40:20 user nova-compute[82196]:         <nova:project uuid="b8e3a291c54b49db8e12a88ba41865e3">tempest-ServerRescueNegativeTestJSON-1429831687</nova:project>
Apr 11 19:40:20 user nova-compute[82196]:       </nova:owner>
Apr 11 19:40:20 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:40:20 user nova-compute[82196]:       <nova:ports>
Apr 11 19:40:20 user nova-compute[82196]:         <nova:port uuid="c662b1b3-b2b3-4502-81af-9afdf3e591dc">
Apr 11 19:40:20 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:40:20 user nova-compute[82196]:         </nova:port>
Apr 11 19:40:20 user nova-compute[82196]:       </nova:ports>
Apr 11 19:40:20 user nova-compute[82196]:     </nova:instance>
Apr 11 19:40:20 user nova-compute[82196]:   </metadata>
Apr 11 19:40:20 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:40:20 user nova-compute[82196]:     <system>
Apr 11 19:40:20 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:40:20 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:40:20 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:40:20 user nova-compute[82196]:       <entry name="serial">bf0a75f5-2f44-4687-af12-046f6761fee2</entry>
Apr 11 19:40:20 user nova-compute[82196]:       <entry name="uuid">bf0a75f5-2f44-4687-af12-046f6761fee2</entry>
Apr 11 19:40:20 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:40:20 user nova-compute[82196]:     </system>
Apr 11 19:40:20 user nova-compute[82196]:   </sysinfo>
Apr 11 19:40:20 user nova-compute[82196]:   <os>
Apr 11 19:40:20 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:40:20 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:40:20 user nova-compute[82196]:   </os>
Apr 11 19:40:20 user nova-compute[82196]:   <features>
Apr 11 19:40:20 user nova-compute[82196]:     <acpi/>
Apr 11 19:40:20 user nova-compute[82196]:     <apic/>
Apr 11 19:40:20 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:40:20 user nova-compute[82196]:   </features>
Apr 11 19:40:20 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:40:20 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:40:20 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:40:20 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:40:20 user nova-compute[82196]:   </clock>
Apr 11 19:40:20 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:40:20 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:40:20 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:40:20 user nova-compute[82196]:   </cpu>
Apr 11 19:40:20 user nova-compute[82196]:   <devices>
Apr 11 19:40:20 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:40:20 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:40:20 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.rescue"/>
Apr 11 19:40:20 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:40:20 user nova-compute[82196]:     </disk>
Apr 11 19:40:20 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:40:20 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:40:20 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk"/>
Apr 11 19:40:20 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:40:20 user nova-compute[82196]:     </disk>
Apr 11 19:40:20 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:40:20 user nova-compute[82196]:       <mac address="fa:16:3e:16:43:8c"/>
Apr 11 19:40:20 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:40:20 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:40:20 user nova-compute[82196]:       <target dev="tapc662b1b3-b2"/>
Apr 11 19:40:20 user nova-compute[82196]:     </interface>
Apr 11 19:40:20 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:40:20 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/console.log" append="off"/>
Apr 11 19:40:20 user nova-compute[82196]:     </serial>
Apr 11 19:40:20 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:40:20 user nova-compute[82196]:     <video>
Apr 11 19:40:20 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:40:20 user nova-compute[82196]:     </video>
Apr 11 19:40:20 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:40:20 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:40:20 user nova-compute[82196]:     </rng>
Apr 11 19:40:20 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:40:20 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:40:20 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:40:20 user nova-compute[82196]:     </memballoon>
Apr 11 19:40:20 user nova-compute[82196]:   </devices>
Apr 11 19:40:20 user nova-compute[82196]: </domain>
Apr 11 19:40:20 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:40:20 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Instance destroyed successfully.
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] No VIF found with MAC fa:16:3e:16:43:8c, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-unplugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] No waiting events found dispatching network-vif-unplugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:20 user nova-compute[82196]: WARNING nova.compute.manager [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received unexpected event network-vif-unplugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance with vm_state active and task_state rescuing.
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] No waiting events found dispatching network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:20 user nova-compute[82196]: WARNING nova.compute.manager [req-1bf55d54-edfe-4374-a775-87abedde8502 req-bc6ca503-23a6-40ce-af6d-171abbcbbe9b service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received unexpected event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance with vm_state active and task_state rescuing.
Apr 11 19:40:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] No waiting events found dispatching network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:22 user nova-compute[82196]: WARNING nova.compute.manager [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received unexpected event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance with vm_state active and task_state rescuing.
Apr 11 19:40:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:22 user nova-compute[82196]: DEBUG nova.compute.manager [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] No waiting events found dispatching network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:22 user nova-compute[82196]: WARNING nova.compute.manager [req-3cf76fd3-601a-4549-b5e4-3c3073f6d5b1 req-1c4ba7cb-3bc3-45d6-b945-19c29ed6296b service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received unexpected event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance with vm_state active and task_state rescuing.
Apr 11 19:40:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:24 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for bf0a75f5-2f44-4687-af12-046f6761fee2 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:40:24 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242024.9666195, bf0a75f5-2f44-4687-af12-046f6761fee2 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:40:24 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] VM Resumed (Lifecycle Event)
Apr 11 19:40:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-b7aefd58-368e-4109-abfe-509402a4e78e tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:24 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:40:25 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 19:40:25 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242024.9706697, bf0a75f5-2f44-4687-af12-046f6761fee2 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:40:25 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] VM Started (Lifecycle Event)
Apr 11 19:40:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:25 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:40:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "0a59d114-20ac-448e-a95a-d3501c914833" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "0a59d114-20ac-448e-a95a-d3501c914833" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:40:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:29 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:40:29 user nova-compute[82196]: INFO nova.compute.claims [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Claim successful on node user
Apr 11 19:40:29 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:40:29 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:40:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:40:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:40:29 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:40:29 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:40:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:40:29 user nova-compute[82196]: INFO nova.virt.block_device [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Booting with volume af3920bc-0034-4875-be3a-b25fe27ee037 at /dev/vda
Apr 11 19:40:30 user nova-compute[82196]: DEBUG os_brick.utils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47e1d4f-727a-450c-ae8a-529bad0fdf5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG nova.policy [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f82d6b-93b2-40e0-a1b4-91f1e3721adf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[017f53e3-fa54-46f8-a669-cf34637064f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c4fd25-8dd3-49ff-a77d-d481be0dfbf0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:40:30 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:40:30 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[40718b36-db8b-44d4-b590-510d65b7cd64]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG os_brick.utils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Updating existing volume attachment record: bc684d85-622e-4c0e-a814-83df5efc1f78 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:40:30 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Successfully created port: 41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Successfully updated port: 41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "refresh_cache-0a59d114-20ac-448e-a95a-d3501c914833" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquired lock "refresh_cache-0a59d114-20ac-448e-a95a-d3501c914833" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Received event network-changed-41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG nova.compute.manager [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Refreshing instance network info cache due to event network-changed-41122899-3bba-4bdd-a114-61f342be91ae. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] Acquiring lock "refresh_cache-0a59d114-20ac-448e-a95a-d3501c914833" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Updating instance_info_cache with network_info: [{"id": "41122899-3bba-4bdd-a114-61f342be91ae", "address": "fa:16:3e:c5:aa:44", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41122899-3b", "ovs_interfaceid": "41122899-3bba-4bdd-a114-61f342be91ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Releasing lock "refresh_cache-0a59d114-20ac-448e-a95a-d3501c914833" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Instance network_info: |[{"id": "41122899-3bba-4bdd-a114-61f342be91ae", "address": "fa:16:3e:c5:aa:44", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41122899-3b", "ovs_interfaceid": "41122899-3bba-4bdd-a114-61f342be91ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] Acquired lock "refresh_cache-0a59d114-20ac-448e-a95a-d3501c914833" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:40:31 user nova-compute[82196]: DEBUG nova.network.neutron [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Refreshing network info cache for port 41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:40:32 user nova-compute[82196]: DEBUG nova.network.neutron [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Updated VIF entry in instance network info cache for port 41122899-3bba-4bdd-a114-61f342be91ae. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:40:32 user nova-compute[82196]: DEBUG nova.network.neutron [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Updating instance_info_cache with network_info: [{"id": "41122899-3bba-4bdd-a114-61f342be91ae", "address": "fa:16:3e:c5:aa:44", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41122899-3b", "ovs_interfaceid": "41122899-3bba-4bdd-a114-61f342be91ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:40:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-74c5c7a1-0e31-4a64-bb3c-7f40de5589f9 req-45cd4a1a-b18d-47d3-959e-c1e0cf9226e0 service nova] Releasing lock "refresh_cache-0a59d114-20ac-448e-a95a-d3501c914833" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:40:32 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242017.4214704, 647674d8-af53-405a-8116-4b7a01549bdf => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:40:32 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] VM Stopped (Lifecycle Event)
Apr 11 19:40:32 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e578a079-b63d-4ff9-9238-79ed58b5c0d8 None None] [instance: 647674d8-af53-405a-8116-4b7a01549bdf] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:40:35 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Creating image(s)
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Ensure instance console log exists: /opt/stack/data/nova/instances/0a59d114-20ac-448e-a95a-d3501c914833/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Start _get_guest_xml network_info=[{"id": "41122899-3bba-4bdd-a114-61f342be91ae", "address": "fa:16:3e:c5:aa:44", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41122899-3b", "ovs_interfaceid": "41122899-3bba-4bdd-a114-61f342be91ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwEJArRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a59d114-20ac-448e-a95a-d3501c914833', 'attached_at': '', 'detached_at': '', 'volume_id': 'af3920bc-0034-4875-be3a-b25fe27ee037', 'serial': 'af3920bc-0034-4875-be3a-b25fe27ee037'}, 'attachment_id': 'bc684d85-622e-4c0e-a814-83df5efc1f78', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:40:35 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:40:35 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwEJArRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:40:35 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:40:35 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:40:35 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c529437b-0323-4503-9315-1b37093b28c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:40:35 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23092d7-3351-417e-a06c-cfa2e6b71bf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037] added
Apr 11 19:40:35 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffd4f05-6313-4595-9fcb-698ea02e98ba]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdc7c3f-786b-484c-b6d7-fbf40f6ab13c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwEJArRC {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwEJArRC" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6ab575-6fab-48dd-b37b-8ffa18ea780f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iwEJArRC'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13a6dd5-f4ee-4304-9c7c-5de87f554cc8]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7659f236-745c-4593-988a-df97a5722d33]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:40:35 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:40:35 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbc15d9-0410-4db7-ab9f-fcecd21ead33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260]
Apr 11 19:40:35 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260] successful.
Apr 11 19:40:35 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[07062569-85fb-4fd2-9e9e-155acb734ba9]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac1f2e4-cc54-4982-bc8d-645d4f72a892]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:40:35 user nova-compute[82196]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:40:35 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac4a70a-4e89-496a-a8ec-91e912985593]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:40:35 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwEJArRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23830353935353039', 'path': '/dev/sdd'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830353935353039', 'path': '/dev/sdd'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1799082805',display_name='tempest-TestVolumeBootPattern-server-1799082805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1799082805',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPal5dIOOTQX1AtimGkw05FO0Z9eaerqpiFYTxmlD5RcLLewnhLN4pAKWK7d0rX0zQgFYrr+JvrnM8AxIhiJUbrvnXCoFiGl5kaOegYnss1VivHpq7rMu1EVV1XJIRedHg==',key_name='tempest-TestVolumeBootPattern-1844027973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-ogapa1it',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:40:30Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=0a59d114-20ac-448e-a95a-d3501c914833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41122899-3bba-4bdd-a114-61f342be91ae", "address": "fa:16:3e:c5:aa:44", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41122899-3b", "ovs_interfaceid": "41122899-3bba-4bdd-a114-61f342be91ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "41122899-3bba-4bdd-a114-61f342be91ae", "address": "fa:16:3e:c5:aa:44", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41122899-3b", "ovs_interfaceid": "41122899-3bba-4bdd-a114-61f342be91ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=41122899-3bba-4bdd-a114-61f342be91ae,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41122899-3b') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG nova.objects.instance [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a59d114-20ac-448e-a95a-d3501c914833 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:40:36 user nova-compute[82196]:   <uuid>0a59d114-20ac-448e-a95a-d3501c914833</uuid>
Apr 11 19:40:36 user nova-compute[82196]:   <name>instance-00000027</name>
Apr 11 19:40:36 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:40:36 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:40:36 user nova-compute[82196]:   <metadata>
Apr 11 19:40:36 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:40:36 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:40:36 user nova-compute[82196]:       <nova:name>tempest-TestVolumeBootPattern-server-1799082805</nova:name>
Apr 11 19:40:36 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:40:35</nova:creationTime>
Apr 11 19:40:36 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:40:36 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:40:36 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:40:36 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:40:36 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:40:36 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:40:36 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:40:36 user nova-compute[82196]:       <nova:owner>
Apr 11 19:40:36 user nova-compute[82196]:         <nova:user uuid="cf262cd03f4a41c4956d8784cf37d86d">tempest-TestVolumeBootPattern-935343500-project-member</nova:user>
Apr 11 19:40:36 user nova-compute[82196]:         <nova:project uuid="2caba0618fc743e7bfb2dd866a511df9">tempest-TestVolumeBootPattern-935343500</nova:project>
Apr 11 19:40:36 user nova-compute[82196]:       </nova:owner>
Apr 11 19:40:36 user nova-compute[82196]:       <nova:ports>
Apr 11 19:40:36 user nova-compute[82196]:         <nova:port uuid="41122899-3bba-4bdd-a114-61f342be91ae">
Apr 11 19:40:36 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 19:40:36 user nova-compute[82196]:         </nova:port>
Apr 11 19:40:36 user nova-compute[82196]:       </nova:ports>
Apr 11 19:40:36 user nova-compute[82196]:     </nova:instance>
Apr 11 19:40:36 user nova-compute[82196]:   </metadata>
Apr 11 19:40:36 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:40:36 user nova-compute[82196]:     <system>
Apr 11 19:40:36 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:40:36 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:40:36 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:40:36 user nova-compute[82196]:       <entry name="serial">0a59d114-20ac-448e-a95a-d3501c914833</entry>
Apr 11 19:40:36 user nova-compute[82196]:       <entry name="uuid">0a59d114-20ac-448e-a95a-d3501c914833</entry>
Apr 11 19:40:36 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:40:36 user nova-compute[82196]:     </system>
Apr 11 19:40:36 user nova-compute[82196]:   </sysinfo>
Apr 11 19:40:36 user nova-compute[82196]:   <os>
Apr 11 19:40:36 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:40:36 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:40:36 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:40:36 user nova-compute[82196]:   </os>
Apr 11 19:40:36 user nova-compute[82196]:   <features>
Apr 11 19:40:36 user nova-compute[82196]:     <acpi/>
Apr 11 19:40:36 user nova-compute[82196]:     <apic/>
Apr 11 19:40:36 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:40:36 user nova-compute[82196]:   </features>
Apr 11 19:40:36 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:40:36 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:40:36 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:40:36 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:40:36 user nova-compute[82196]:   </clock>
Apr 11 19:40:36 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:40:36 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:40:36 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:40:36 user nova-compute[82196]:   </cpu>
Apr 11 19:40:36 user nova-compute[82196]:   <devices>
Apr 11 19:40:36 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:40:36 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:40:36 user nova-compute[82196]:       <source dev="/dev/sdd"/>
Apr 11 19:40:36 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:40:36 user nova-compute[82196]:       <serial>af3920bc-0034-4875-be3a-b25fe27ee037</serial>
Apr 11 19:40:36 user nova-compute[82196]:     </disk>
Apr 11 19:40:36 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:40:36 user nova-compute[82196]:       <mac address="fa:16:3e:c5:aa:44"/>
Apr 11 19:40:36 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:40:36 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:40:36 user nova-compute[82196]:       <target dev="tap41122899-3b"/>
Apr 11 19:40:36 user nova-compute[82196]:     </interface>
Apr 11 19:40:36 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:40:36 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/0a59d114-20ac-448e-a95a-d3501c914833/console.log" append="off"/>
Apr 11 19:40:36 user nova-compute[82196]:     </serial>
Apr 11 19:40:36 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:40:36 user nova-compute[82196]:     <video>
Apr 11 19:40:36 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:40:36 user nova-compute[82196]:     </video>
Apr 11 19:40:36 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:40:36 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:40:36 user nova-compute[82196]:     </rng>
Apr 11 19:40:36 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:40:36 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:40:36 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:40:36 user nova-compute[82196]:     </memballoon>
Apr 11 19:40:36 user nova-compute[82196]:   </devices>
Apr 11 19:40:36 user nova-compute[82196]: </domain>
Apr 11 19:40:36 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1799082805',display_name='tempest-TestVolumeBootPattern-server-1799082805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1799082805',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPal5dIOOTQX1AtimGkw05FO0Z9eaerqpiFYTxmlD5RcLLewnhLN4pAKWK7d0rX0zQgFYrr+JvrnM8AxIhiJUbrvnXCoFiGl5kaOegYnss1VivHpq7rMu1EVV1XJIRedHg==',key_name='tempest-TestVolumeBootPattern-1844027973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-ogapa1it',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:40:30Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=0a59d114-20ac-448e-a95a-d3501c914833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41122899-3bba-4bdd-a114-61f342be91ae", "address": "fa:16:3e:c5:aa:44", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41122899-3b", "ovs_interfaceid": "41122899-3bba-4bdd-a114-61f342be91ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "41122899-3bba-4bdd-a114-61f342be91ae", "address": "fa:16:3e:c5:aa:44", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41122899-3b", "ovs_interfaceid": "41122899-3bba-4bdd-a114-61f342be91ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=41122899-3bba-4bdd-a114-61f342be91ae,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41122899-3b') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG os_vif [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=41122899-3bba-4bdd-a114-61f342be91ae,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41122899-3b') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41122899-3b, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41122899-3b, col_values=(('external_ids', {'iface-id': '41122899-3bba-4bdd-a114-61f342be91ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:aa:44', 'vm-uuid': '0a59d114-20ac-448e-a95a-d3501c914833'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:36 user nova-compute[82196]: INFO os_vif [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=41122899-3bba-4bdd-a114-61f342be91ae,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41122899-3b')
Apr 11 19:40:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:40:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] No VIF found with MAC fa:16:3e:c5:aa:44, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:40:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-33f4e516-0ed0-48f8-b287-7981ede361a7 req-73a7fae1-17de-418b-8f8f-8d048dd64055 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Received event network-vif-plugged-41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-33f4e516-0ed0-48f8-b287-7981ede361a7 req-73a7fae1-17de-418b-8f8f-8d048dd64055 service nova] Acquiring lock "0a59d114-20ac-448e-a95a-d3501c914833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-33f4e516-0ed0-48f8-b287-7981ede361a7 req-73a7fae1-17de-418b-8f8f-8d048dd64055 service nova] Lock "0a59d114-20ac-448e-a95a-d3501c914833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-33f4e516-0ed0-48f8-b287-7981ede361a7 req-73a7fae1-17de-418b-8f8f-8d048dd64055 service nova] Lock "0a59d114-20ac-448e-a95a-d3501c914833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-33f4e516-0ed0-48f8-b287-7981ede361a7 req-73a7fae1-17de-418b-8f8f-8d048dd64055 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] No waiting events found dispatching network-vif-plugged-41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:38 user nova-compute[82196]: WARNING nova.compute.manager [req-33f4e516-0ed0-48f8-b287-7981ede361a7 req-73a7fae1-17de-418b-8f8f-8d048dd64055 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Received unexpected event network-vif-plugged-41122899-3bba-4bdd-a114-61f342be91ae for instance with vm_state building and task_state spawning.
Apr 11 19:40:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242040.1790123, 0a59d114-20ac-448e-a95a-d3501c914833 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:40:40 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] VM Resumed (Lifecycle Event)
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:40:40 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Instance spawned successfully.
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:40:40 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242040.182731, 0a59d114-20ac-448e-a95a-d3501c914833 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:40:40 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] VM Started (Lifecycle Event)
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:40:40 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.compute.manager [req-4e60aeaf-171a-4451-b33e-80c34f9f0203 req-18b2214c-88f4-4c1d-b87c-e7e7432574d7 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Received event network-vif-plugged-41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4e60aeaf-171a-4451-b33e-80c34f9f0203 req-18b2214c-88f4-4c1d-b87c-e7e7432574d7 service nova] Acquiring lock "0a59d114-20ac-448e-a95a-d3501c914833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4e60aeaf-171a-4451-b33e-80c34f9f0203 req-18b2214c-88f4-4c1d-b87c-e7e7432574d7 service nova] Lock "0a59d114-20ac-448e-a95a-d3501c914833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4e60aeaf-171a-4451-b33e-80c34f9f0203 req-18b2214c-88f4-4c1d-b87c-e7e7432574d7 service nova] Lock "0a59d114-20ac-448e-a95a-d3501c914833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.compute.manager [req-4e60aeaf-171a-4451-b33e-80c34f9f0203 req-18b2214c-88f4-4c1d-b87c-e7e7432574d7 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] No waiting events found dispatching network-vif-plugged-41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:40 user nova-compute[82196]: WARNING nova.compute.manager [req-4e60aeaf-171a-4451-b33e-80c34f9f0203 req-18b2214c-88f4-4c1d-b87c-e7e7432574d7 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Received unexpected event network-vif-plugged-41122899-3bba-4bdd-a114-61f342be91ae for instance with vm_state building and task_state spawning.
Apr 11 19:40:40 user nova-compute[82196]: INFO nova.compute.manager [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Took 5.12 seconds to spawn the instance on the hypervisor.
Apr 11 19:40:40 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:40 user nova-compute[82196]: INFO nova.compute.manager [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Took 11.01 seconds to build instance.
Apr 11 19:40:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2de1d275-bcee-45a8-bec3-eb3241e52b4c tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "0a59d114-20ac-448e-a95a-d3501c914833" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.098s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:41 user nova-compute[82196]: INFO nova.compute.manager [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Unrescuing
Apr 11 19:40:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "refresh_cache-8c45de50-92bc-467c-9f3d-7e667e1d0bb3" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:40:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquired lock "refresh_cache-8c45de50-92bc-467c-9f3d-7e667e1d0bb3" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:40:41 user nova-compute[82196]: DEBUG nova.network.neutron [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:40:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:41 user nova-compute[82196]: DEBUG nova.network.neutron [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Updating instance_info_cache with network_info: [{"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:40:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Releasing lock "refresh_cache-8c45de50-92bc-467c-9f3d-7e667e1d0bb3" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:40:41 user nova-compute[82196]: DEBUG nova.objects.instance [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'flavor' on Instance uuid 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:42 user nova-compute[82196]: DEBUG nova.compute.manager [req-55419859-768b-4a8e-89d5-f1d72c0ca14d req-a173d3da-f395-4f88-981d-1a67ef3a4bb6 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-unplugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-55419859-768b-4a8e-89d5-f1d72c0ca14d req-a173d3da-f395-4f88-981d-1a67ef3a4bb6 service nova] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-55419859-768b-4a8e-89d5-f1d72c0ca14d req-a173d3da-f395-4f88-981d-1a67ef3a4bb6 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:42 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-55419859-768b-4a8e-89d5-f1d72c0ca14d req-a173d3da-f395-4f88-981d-1a67ef3a4bb6 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:42 user nova-compute[82196]: DEBUG nova.compute.manager [req-55419859-768b-4a8e-89d5-f1d72c0ca14d req-a173d3da-f395-4f88-981d-1a67ef3a4bb6 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] No waiting events found dispatching network-vif-unplugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:42 user nova-compute[82196]: WARNING nova.compute.manager [req-55419859-768b-4a8e-89d5-f1d72c0ca14d req-a173d3da-f395-4f88-981d-1a67ef3a4bb6 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received unexpected event network-vif-unplugged-82ee2878-c477-419c-97ba-9ac4b36dacab for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:40:42 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Instance destroyed successfully.
Apr 11 19:40:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] No waiting events found dispatching network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:44 user nova-compute[82196]: WARNING nova.compute.manager [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received unexpected event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:40:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] No waiting events found dispatching network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:44 user nova-compute[82196]: WARNING nova.compute.manager [req-9df88d5b-645c-469e-9208-c96e71dd2db8 req-5d8ea6e7-31dc-4e5a-85a6-024933f4e95f service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received unexpected event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:40:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:45 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:40:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:40:46 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242046.3881392, 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:40:46 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] VM Resumed (Lifecycle Event)
Apr 11 19:40:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-eae414e5-b561-4117-a5a5-4cb8be9c6346 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:40:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:40:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:40:46 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 19:40:46 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242046.388553, 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:40:46 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] VM Started (Lifecycle Event)
Apr 11 19:40:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:40:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:40:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-83dcacf4-9c7c-4200-b999-7d458e01531a req-21fe5f58-ad16-4c48-aac0-bed1280a575a service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:40:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-83dcacf4-9c7c-4200-b999-7d458e01531a req-21fe5f58-ad16-4c48-aac0-bed1280a575a service nova] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-83dcacf4-9c7c-4200-b999-7d458e01531a req-21fe5f58-ad16-4c48-aac0-bed1280a575a service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-83dcacf4-9c7c-4200-b999-7d458e01531a req-21fe5f58-ad16-4c48-aac0-bed1280a575a service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-83dcacf4-9c7c-4200-b999-7d458e01531a req-21fe5f58-ad16-4c48-aac0-bed1280a575a service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] No waiting events found dispatching network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:40:46 user nova-compute[82196]: WARNING nova.compute.manager [req-83dcacf4-9c7c-4200-b999-7d458e01531a req-21fe5f58-ad16-4c48-aac0-bed1280a575a service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received unexpected event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab for instance with vm_state active and task_state None.
Apr 11 19:40:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:47 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:40:47 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:40:47 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:40:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:40:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:40:47 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:40:47 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:40:48 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Updating instance_info_cache with network_info: [{"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:40:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:40:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:40:50 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:40:50 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:40:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:53 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:40:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:53 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:40:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:40:55 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:40:55 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:40:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7839MB free_disk=26.085369110107422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:40:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance b079367a-558e-4920-ad8d-972a8065260c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bf0a75f5-2f44-4687-af12-046f6761fee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance d42dc0ea-4631-44be-8b58-09877280ba2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 0a59d114-20ac-448e-a95a-d3501c914833 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:40:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:00 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:41:00 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:41:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:41:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:41:08 user nova-compute[82196]: INFO nova.compute.claims [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Claim successful on node user
Apr 11 19:41:08 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG nova.network.neutron [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:41:08 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:41:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG nova.policy [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:41:08 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Creating image(s)
Apr 11 19:41:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "/opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "/opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "/opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.153s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk 1073741824" returned: 0 in 0.056s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.156s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Cannot resize image /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG nova.objects.instance [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'migration_context' on Instance uuid 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Ensure instance console log exists: /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Successfully created port: 91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:41:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Successfully updated port: 91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:41:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:41:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquired lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:41:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:41:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Received event network-changed-91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:41:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Refreshing instance network info cache due to event network-changed-91ef79db-4548-423d-9022-b88dd7608438. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:41:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] Acquiring lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:41:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Updating instance_info_cache with network_info: [{"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Releasing lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Instance network_info: |[{"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] Acquired lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.network.neutron [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Refreshing network info cache for port 91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Start _get_guest_xml network_info=[{"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:41:11 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:41:11 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1690661928',display_name='tempest-ServerActionsTestJSON-server-1690661928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1690661928',id=40,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-z5t0whzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=478eb884-ba19-4a4b-b1eb-a2e59d6beef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=91ef79db-4548-423d-9022-b88dd7608438,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ef79db-45') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.objects.instance [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'pci_devices' on Instance uuid 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:41:11 user nova-compute[82196]:   <uuid>478eb884-ba19-4a4b-b1eb-a2e59d6beef0</uuid>
Apr 11 19:41:11 user nova-compute[82196]:   <name>instance-00000028</name>
Apr 11 19:41:11 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:41:11 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:41:11 user nova-compute[82196]:   <metadata>
Apr 11 19:41:11 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:41:11 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:41:11 user nova-compute[82196]:       <nova:name>tempest-ServerActionsTestJSON-server-1690661928</nova:name>
Apr 11 19:41:11 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:41:11</nova:creationTime>
Apr 11 19:41:11 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:41:11 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:41:11 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:41:11 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:41:11 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:41:11 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:41:11 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:41:11 user nova-compute[82196]:       <nova:owner>
Apr 11 19:41:11 user nova-compute[82196]:         <nova:user uuid="05fb551c320a48f98a4ec00a7f7492d7">tempest-ServerActionsTestJSON-37730514-project-member</nova:user>
Apr 11 19:41:11 user nova-compute[82196]:         <nova:project uuid="60a7381a31b84e97a068528f90813773">tempest-ServerActionsTestJSON-37730514</nova:project>
Apr 11 19:41:11 user nova-compute[82196]:       </nova:owner>
Apr 11 19:41:11 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:41:11 user nova-compute[82196]:       <nova:ports>
Apr 11 19:41:11 user nova-compute[82196]:         <nova:port uuid="91ef79db-4548-423d-9022-b88dd7608438">
Apr 11 19:41:11 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 19:41:11 user nova-compute[82196]:         </nova:port>
Apr 11 19:41:11 user nova-compute[82196]:       </nova:ports>
Apr 11 19:41:11 user nova-compute[82196]:     </nova:instance>
Apr 11 19:41:11 user nova-compute[82196]:   </metadata>
Apr 11 19:41:11 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:41:11 user nova-compute[82196]:     <system>
Apr 11 19:41:11 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:41:11 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:41:11 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:41:11 user nova-compute[82196]:       <entry name="serial">478eb884-ba19-4a4b-b1eb-a2e59d6beef0</entry>
Apr 11 19:41:11 user nova-compute[82196]:       <entry name="uuid">478eb884-ba19-4a4b-b1eb-a2e59d6beef0</entry>
Apr 11 19:41:11 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:41:11 user nova-compute[82196]:     </system>
Apr 11 19:41:11 user nova-compute[82196]:   </sysinfo>
Apr 11 19:41:11 user nova-compute[82196]:   <os>
Apr 11 19:41:11 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:41:11 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:41:11 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:41:11 user nova-compute[82196]:   </os>
Apr 11 19:41:11 user nova-compute[82196]:   <features>
Apr 11 19:41:11 user nova-compute[82196]:     <acpi/>
Apr 11 19:41:11 user nova-compute[82196]:     <apic/>
Apr 11 19:41:11 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:41:11 user nova-compute[82196]:   </features>
Apr 11 19:41:11 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:41:11 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:41:11 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:41:11 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:41:11 user nova-compute[82196]:   </clock>
Apr 11 19:41:11 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:41:11 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:41:11 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:41:11 user nova-compute[82196]:   </cpu>
Apr 11 19:41:11 user nova-compute[82196]:   <devices>
Apr 11 19:41:11 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:41:11 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:41:11 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk"/>
Apr 11 19:41:11 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:41:11 user nova-compute[82196]:     </disk>
Apr 11 19:41:11 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:41:11 user nova-compute[82196]:       <mac address="fa:16:3e:0d:f0:20"/>
Apr 11 19:41:11 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:41:11 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:41:11 user nova-compute[82196]:       <target dev="tap91ef79db-45"/>
Apr 11 19:41:11 user nova-compute[82196]:     </interface>
Apr 11 19:41:11 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:41:11 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/console.log" append="off"/>
Apr 11 19:41:11 user nova-compute[82196]:     </serial>
Apr 11 19:41:11 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:41:11 user nova-compute[82196]:     <video>
Apr 11 19:41:11 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:41:11 user nova-compute[82196]:     </video>
Apr 11 19:41:11 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:41:11 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:41:11 user nova-compute[82196]:     </rng>
Apr 11 19:41:11 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:41:11 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:41:11 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:41:11 user nova-compute[82196]:     </memballoon>
Apr 11 19:41:11 user nova-compute[82196]:   </devices>
Apr 11 19:41:11 user nova-compute[82196]: </domain>
Apr 11 19:41:11 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1690661928',display_name='tempest-ServerActionsTestJSON-server-1690661928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1690661928',id=40,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-z5t0whzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=478eb884-ba19-4a4b-b1eb-a2e59d6beef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=91ef79db-4548-423d-9022-b88dd7608438,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ef79db-45') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG os_vif [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=91ef79db-4548-423d-9022-b88dd7608438,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ef79db-45') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91ef79db-45, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91ef79db-45, col_values=(('external_ids', {'iface-id': '91ef79db-4548-423d-9022-b88dd7608438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:f0:20', 'vm-uuid': '478eb884-ba19-4a4b-b1eb-a2e59d6beef0'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:11 user nova-compute[82196]: INFO os_vif [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=91ef79db-4548-423d-9022-b88dd7608438,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ef79db-45')
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No VIF found with MAC fa:16:3e:0d:f0:20, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.network.neutron [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Updated VIF entry in instance network info cache for port 91ef79db-4548-423d-9022-b88dd7608438. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG nova.network.neutron [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Updating instance_info_cache with network_info: [{"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:41:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-531d27c5-c528-40b6-a575-7e217b23e8c7 req-4817b483-ebff-4ee5-be45-b9f4d3003665 service nova] Releasing lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:41:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-e631579f-b40b-46b6-99b2-20a4b9dd7d56 req-82482822-00de-4703-9df9-9da611f902cd service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Received event network-vif-plugged-91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:41:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e631579f-b40b-46b6-99b2-20a4b9dd7d56 req-82482822-00de-4703-9df9-9da611f902cd service nova] Acquiring lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e631579f-b40b-46b6-99b2-20a4b9dd7d56 req-82482822-00de-4703-9df9-9da611f902cd service nova] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e631579f-b40b-46b6-99b2-20a4b9dd7d56 req-82482822-00de-4703-9df9-9da611f902cd service nova] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-e631579f-b40b-46b6-99b2-20a4b9dd7d56 req-82482822-00de-4703-9df9-9da611f902cd service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] No waiting events found dispatching network-vif-plugged-91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:41:13 user nova-compute[82196]: WARNING nova.compute.manager [req-e631579f-b40b-46b6-99b2-20a4b9dd7d56 req-82482822-00de-4703-9df9-9da611f902cd service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Received unexpected event network-vif-plugged-91ef79db-4548-423d-9022-b88dd7608438 for instance with vm_state building and task_state spawning.
Apr 11 19:41:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242075.1291795, 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:41:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] VM Resumed (Lifecycle Event)
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:41:15 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Instance spawned successfully.
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:41:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242075.1305256, 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:41:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] VM Started (Lifecycle Event)
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-f68bdacd-4eab-49df-b28e-acfe63162375 req-0aed1a2d-d619-4e9c-b075-e291a381466d service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Received event network-vif-plugged-91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f68bdacd-4eab-49df-b28e-acfe63162375 req-0aed1a2d-d619-4e9c-b075-e291a381466d service nova] Acquiring lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f68bdacd-4eab-49df-b28e-acfe63162375 req-0aed1a2d-d619-4e9c-b075-e291a381466d service nova] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f68bdacd-4eab-49df-b28e-acfe63162375 req-0aed1a2d-d619-4e9c-b075-e291a381466d service nova] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-f68bdacd-4eab-49df-b28e-acfe63162375 req-0aed1a2d-d619-4e9c-b075-e291a381466d service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] No waiting events found dispatching network-vif-plugged-91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:41:15 user nova-compute[82196]: WARNING nova.compute.manager [req-f68bdacd-4eab-49df-b28e-acfe63162375 req-0aed1a2d-d619-4e9c-b075-e291a381466d service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Received unexpected event network-vif-plugged-91ef79db-4548-423d-9022-b88dd7608438 for instance with vm_state building and task_state spawning.
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:41:15 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:41:15 user nova-compute[82196]: INFO nova.compute.manager [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Took 6.38 seconds to spawn the instance on the hypervisor.
Apr 11 19:41:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:41:15 user nova-compute[82196]: INFO nova.compute.manager [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Took 7.13 seconds to build instance.
Apr 11 19:41:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-bdaf6d42-ccff-4770-a2ec-32fbc12c48a5 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.226s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:41:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:41:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:47 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:41:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:48 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:41:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:41:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:41:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:41:48 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:41:49 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Updating instance_info_cache with network_info: [{"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:41:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-864fcd9b-8e5b-4de8-a2e6-292a8907a834" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:41:49 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:41:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:50 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:41:51 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:41:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-changed-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:41:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Refreshing instance network info cache due to event network-changed-fd43e974-64b6-4605-83cb-11b9cfe58341. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:41:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] Acquiring lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:41:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] Acquired lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:41:52 user nova-compute[82196]: DEBUG nova.network.neutron [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Refreshing network info cache for port fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:53 user nova-compute[82196]: INFO nova.compute.manager [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Terminating instance
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:41:53 user nova-compute[82196]: INFO nova.compute.claims [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Claim successful on node user
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-92b2c85d-b493-4f84-ba5d-52f1082f5c3d req-1b3cd84c-3b05-4360-a2c6-5578046105c2 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-vif-unplugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-92b2c85d-b493-4f84-ba5d-52f1082f5c3d req-1b3cd84c-3b05-4360-a2c6-5578046105c2 service nova] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-92b2c85d-b493-4f84-ba5d-52f1082f5c3d req-1b3cd84c-3b05-4360-a2c6-5578046105c2 service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-92b2c85d-b493-4f84-ba5d-52f1082f5c3d req-1b3cd84c-3b05-4360-a2c6-5578046105c2 service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-92b2c85d-b493-4f84-ba5d-52f1082f5c3d req-1b3cd84c-3b05-4360-a2c6-5578046105c2 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] No waiting events found dispatching network-vif-unplugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-92b2c85d-b493-4f84-ba5d-52f1082f5c3d req-1b3cd84c-3b05-4360-a2c6-5578046105c2 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-vif-unplugged-fd43e974-64b6-4605-83cb-11b9cfe58341 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.network.neutron [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updated VIF entry in instance network info cache for port fd43e974-64b6-4605-83cb-11b9cfe58341. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.network.neutron [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updating instance_info_cache with network_info: [{"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1afaaa41-de56-4adb-86f6-42474ba55389 req-0f206523-499f-48b0-8ce8-3b0317268a7f service nova] Releasing lock "refresh_cache-d42dc0ea-4631-44be-8b58-09877280ba2e" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:41:53 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Instance destroyed successfully.
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.objects.instance [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lazy-loading 'resources' on Instance uuid d42dc0ea-4631-44be-8b58-09877280ba2e {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T19:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-63091414',display_name='tempest-TestShelveInstance-server-63091414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-63091414',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWOJEcAet7cYNYxgnjtKjY7EQdZEK+sNwCTk8xWL8WixGkKk2vUONnTt9oMkdV+yembu+c8rHexAl3dfd0YzfkTAZ1D5FG2Y66/ZHnUkpqMPcyP8plrDur+CPwxyvFqNQ==',key_name='tempest-TestShelveInstance-1765937682',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:40:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7b9baa081ca455ea6931b7801c805b8',ramdisk_id='',reservation_id='r-90gk500j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1694566228',owner_user_name='tempest-TestShelveInstance-1694566228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:40:14Z,user_data=None,user_id='68fcdcd3af164195bf0c7da3b8dfecb7',uuid=d42dc0ea-4631-44be-8b58-09877280ba2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Converting VIF {"id": "fd43e974-64b6-4605-83cb-11b9cfe58341", "address": "fa:16:3e:a4:fd:c3", "network": {"id": "696f6da7-67cb-471b-b825-32cd2415de26", "bridge": "br-int", "label": "tempest-TestShelveInstance-1206431263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b9baa081ca455ea6931b7801c805b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd43e974-64", "ovs_interfaceid": "fd43e974-64b6-4605-83cb-11b9cfe58341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG os_vif [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd43e974-64, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:53 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:41:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:41:53 user nova-compute[82196]: INFO os_vif [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:fd:c3,bridge_name='br-int',has_traffic_filtering=True,id=fd43e974-64b6-4605-83cb-11b9cfe58341,network=Network(696f6da7-67cb-471b-b825-32cd2415de26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd43e974-64')
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arNXGbxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:41:53 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:41:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb72b34-7ad5-44c4-bddd-820cd37858cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:41:53 user nova-compute[82196]: No targets found.
Apr 11 19:41:53 user nova-compute[82196]: iSNS:
Apr 11 19:41:53 user nova-compute[82196]: No targets found.
Apr 11 19:41:53 user nova-compute[82196]: STATIC:
Apr 11 19:41:53 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:41:53 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:41:53 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:41:53 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037
Apr 11 19:41:53 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:41:53 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:41:53 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:41:53 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:41:53 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:41:53 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b
Apr 11 19:41:53 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:41:53 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:41:53 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418
Apr 11 19:41:53 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:41:53 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:41:53 user nova-compute[82196]: FIRMWARE:
Apr 11 19:41:53 user nova-compute[82196]: No targets found.
Apr 11 19:41:53 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:41:53 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:41:53 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e260561-8160-437c-82f4-6e233e7e3000]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[085f95a0-e719-4273-9d31-3dbc756d3cd4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:41:53 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:41:53 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:41:53 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:41:53 user nova-compute[82196]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:41:53 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:41:53 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:41:53 user nova-compute[82196]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 (non-flash)
Apr 11 19:41:53 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:41:53 user nova-compute[82196]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:41:53 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92407c5750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418'): ({'sdc'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Removing single pathed devices sdc {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:41:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e78c30f-24cb-49eb-9807-6fd6e47aa869]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:41:54 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Creating image(s)
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "/opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "/opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[927cf564-f1ec-4b7c-8b24-a0d3ab3a6742]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Flushing IO for device /dev/sdc {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97c55b3-91a7-40f7-8912-3340098f940e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.policy [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b2a4a06b5354121ae49d85be8b02458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0373f7bf54eb8845340bd4e931ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ab7195-3a40-446e-8c28-d21caa47bdca]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec4e9e7-0daa-4d0e-b153-8d66607f7133]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba10fb40-b5aa-4f20-86a2-96f8bb0263f0]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260]
Apr 11 19:41:54 user nova-compute[82196]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418, portal: 172.16.0.220,3260] successful.
Apr 11 19:41:54 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:199762db-3930-4f05-a4da-15dee19e5418 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece95c66-851a-414f-b6ac-94c3491e98dd]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] <== disconnect_volume: return (415ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:41:54 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Deleting instance files /opt/stack/data/nova/instances/d42dc0ea-4631-44be-8b58-09877280ba2e_del
Apr 11 19:41:54 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Deletion of /opt/stack/data/nova/instances/d42dc0ea-4631-44be-8b58-09877280ba2e_del complete
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.158s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:41:54 user nova-compute[82196]: INFO nova.compute.manager [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Took 1.33 seconds to destroy the instance on the hypervisor.
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk 1073741824" returned: 0 in 0.063s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.150s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Cannot resize image /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.objects.instance [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'migration_context' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Ensure instance console log exists: /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Successfully created port: 8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:41:54 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:41:54 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Took 0.57 seconds to deallocate network for instance.
Apr 11 19:41:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-51683cd6-9245-455a-ba6c-9d44d17e9246 req-6bf055b9-5cee-4cff-acb1-3bafe8bbc0b6 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-vif-deleted-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-720c1b16-3a02-4c92-a1f0-51f4c13c79fd req-209c3e2e-279f-4ddd-b06e-70f6316e2ae7 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received event network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-720c1b16-3a02-4c92-a1f0-51f4c13c79fd req-209c3e2e-279f-4ddd-b06e-70f6316e2ae7 service nova] Acquiring lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-720c1b16-3a02-4c92-a1f0-51f4c13c79fd req-209c3e2e-279f-4ddd-b06e-70f6316e2ae7 service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-720c1b16-3a02-4c92-a1f0-51f4c13c79fd req-209c3e2e-279f-4ddd-b06e-70f6316e2ae7 service nova] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-720c1b16-3a02-4c92-a1f0-51f4c13c79fd req-209c3e2e-279f-4ddd-b06e-70f6316e2ae7 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] No waiting events found dispatching network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:41:55 user nova-compute[82196]: WARNING nova.compute.manager [req-720c1b16-3a02-4c92-a1f0-51f4c13c79fd req-209c3e2e-279f-4ddd-b06e-70f6316e2ae7 service nova] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Received unexpected event network-vif-plugged-fd43e974-64b6-4605-83cb-11b9cfe58341 for instance with vm_state active and task_state deleting.
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Successfully updated port: 8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquired lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Received event network-changed-8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Refreshing instance network info cache due to event network-changed-8d43789b-e200-409a-b819-09dd85859b3c. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] Acquiring lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:41:55 user nova-compute[82196]: INFO nova.compute.manager [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Took 0.81 seconds to detach 1 volumes for instance.
Apr 11 19:41:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Deleting volume: 199762db-3930-4f05-a4da-15dee19e5418 {{(pid=82196) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:41:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:56 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Deleted allocations for instance d42dc0ea-4631-44be-8b58-09877280ba2e
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-7d39492d-066d-4ede-9c3a-15acc4451032 tempest-TestShelveInstance-1694566228 tempest-TestShelveInstance-1694566228-project-member] Lock "d42dc0ea-4631-44be-8b58-09877280ba2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.498s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.network.neutron [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updating instance_info_cache with network_info: [{"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Releasing lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Instance network_info: |[{"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] Acquired lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.network.neutron [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Refreshing network info cache for port 8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Start _get_guest_xml network_info=[{"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:41:56 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:41:56 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1913437665',display_name='tempest-SnapshotDataIntegrityTests-server-1913437665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1913437665',id=41,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgEnKjXODkrVP1I9vap7nSk4UwAXw+9cEJPR3Eefq/qUJABtSOM4npeL0Yt2cWOu+Tp/Uq09/jE2WIlZvjGNjfzD5vmuG/JOIfRKdnSH0rl79lcIxVns70WcKMtDpBn1g==',key_name='tempest-SnapshotDataIntegrityTests-234136439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f0373f7bf54eb8845340bd4e931ab2',ramdisk_id='',reservation_id='r-7k037c3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-450067073',owner_user_name='tempest-SnapshotDataIntegrityTests-450067073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:41:54Z,user_data=None,user_id='9b2a4a06b5354121ae49d85be8b02458',uuid=6b110aaa-0f26-4bab-8f3e-d22edb5a5072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Converting VIF {"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a7:89,bridge_name='br-int',has_traffic_filtering=True,id=8d43789b-e200-409a-b819-09dd85859b3c,network=Network(41cb581c-8f02-42e0-ab09-bcc05d4aa23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d43789b-e2') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.objects.instance [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:41:56 user nova-compute[82196]:   <uuid>6b110aaa-0f26-4bab-8f3e-d22edb5a5072</uuid>
Apr 11 19:41:56 user nova-compute[82196]:   <name>instance-00000029</name>
Apr 11 19:41:56 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:41:56 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:41:56 user nova-compute[82196]:   <metadata>
Apr 11 19:41:56 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:41:56 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:41:56 user nova-compute[82196]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1913437665</nova:name>
Apr 11 19:41:56 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:41:56</nova:creationTime>
Apr 11 19:41:56 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:41:56 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:41:56 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:41:56 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:41:56 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:41:56 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:41:56 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:41:56 user nova-compute[82196]:       <nova:owner>
Apr 11 19:41:56 user nova-compute[82196]:         <nova:user uuid="9b2a4a06b5354121ae49d85be8b02458">tempest-SnapshotDataIntegrityTests-450067073-project-member</nova:user>
Apr 11 19:41:56 user nova-compute[82196]:         <nova:project uuid="27f0373f7bf54eb8845340bd4e931ab2">tempest-SnapshotDataIntegrityTests-450067073</nova:project>
Apr 11 19:41:56 user nova-compute[82196]:       </nova:owner>
Apr 11 19:41:56 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:41:56 user nova-compute[82196]:       <nova:ports>
Apr 11 19:41:56 user nova-compute[82196]:         <nova:port uuid="8d43789b-e200-409a-b819-09dd85859b3c">
Apr 11 19:41:56 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 19:41:56 user nova-compute[82196]:         </nova:port>
Apr 11 19:41:56 user nova-compute[82196]:       </nova:ports>
Apr 11 19:41:56 user nova-compute[82196]:     </nova:instance>
Apr 11 19:41:56 user nova-compute[82196]:   </metadata>
Apr 11 19:41:56 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:41:56 user nova-compute[82196]:     <system>
Apr 11 19:41:56 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:41:56 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:41:56 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:41:56 user nova-compute[82196]:       <entry name="serial">6b110aaa-0f26-4bab-8f3e-d22edb5a5072</entry>
Apr 11 19:41:56 user nova-compute[82196]:       <entry name="uuid">6b110aaa-0f26-4bab-8f3e-d22edb5a5072</entry>
Apr 11 19:41:56 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:41:56 user nova-compute[82196]:     </system>
Apr 11 19:41:56 user nova-compute[82196]:   </sysinfo>
Apr 11 19:41:56 user nova-compute[82196]:   <os>
Apr 11 19:41:56 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:41:56 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:41:56 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:41:56 user nova-compute[82196]:   </os>
Apr 11 19:41:56 user nova-compute[82196]:   <features>
Apr 11 19:41:56 user nova-compute[82196]:     <acpi/>
Apr 11 19:41:56 user nova-compute[82196]:     <apic/>
Apr 11 19:41:56 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:41:56 user nova-compute[82196]:   </features>
Apr 11 19:41:56 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:41:56 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:41:56 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:41:56 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:41:56 user nova-compute[82196]:   </clock>
Apr 11 19:41:56 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:41:56 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:41:56 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:41:56 user nova-compute[82196]:   </cpu>
Apr 11 19:41:56 user nova-compute[82196]:   <devices>
Apr 11 19:41:56 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:41:56 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:41:56 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk"/>
Apr 11 19:41:56 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:41:56 user nova-compute[82196]:     </disk>
Apr 11 19:41:56 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:41:56 user nova-compute[82196]:       <mac address="fa:16:3e:d3:a7:89"/>
Apr 11 19:41:56 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:41:56 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:41:56 user nova-compute[82196]:       <target dev="tap8d43789b-e2"/>
Apr 11 19:41:56 user nova-compute[82196]:     </interface>
Apr 11 19:41:56 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:41:56 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/console.log" append="off"/>
Apr 11 19:41:56 user nova-compute[82196]:     </serial>
Apr 11 19:41:56 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:41:56 user nova-compute[82196]:     <video>
Apr 11 19:41:56 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:41:56 user nova-compute[82196]:     </video>
Apr 11 19:41:56 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:41:56 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:41:56 user nova-compute[82196]:     </rng>
Apr 11 19:41:56 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:41:56 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:41:56 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:41:56 user nova-compute[82196]:     </memballoon>
Apr 11 19:41:56 user nova-compute[82196]:   </devices>
Apr 11 19:41:56 user nova-compute[82196]: </domain>
Apr 11 19:41:56 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1913437665',display_name='tempest-SnapshotDataIntegrityTests-server-1913437665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1913437665',id=41,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgEnKjXODkrVP1I9vap7nSk4UwAXw+9cEJPR3Eefq/qUJABtSOM4npeL0Yt2cWOu+Tp/Uq09/jE2WIlZvjGNjfzD5vmuG/JOIfRKdnSH0rl79lcIxVns70WcKMtDpBn1g==',key_name='tempest-SnapshotDataIntegrityTests-234136439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f0373f7bf54eb8845340bd4e931ab2',ramdisk_id='',reservation_id='r-7k037c3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-450067073',owner_user_name='tempest-SnapshotDataIntegrityTests-450067073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:41:54Z,user_data=None,user_id='9b2a4a06b5354121ae49d85be8b02458',uuid=6b110aaa-0f26-4bab-8f3e-d22edb5a5072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Converting VIF {"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a7:89,bridge_name='br-int',has_traffic_filtering=True,id=8d43789b-e200-409a-b819-09dd85859b3c,network=Network(41cb581c-8f02-42e0-ab09-bcc05d4aa23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d43789b-e2') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG os_vif [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a7:89,bridge_name='br-int',has_traffic_filtering=True,id=8d43789b-e200-409a-b819-09dd85859b3c,network=Network(41cb581c-8f02-42e0-ab09-bcc05d4aa23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d43789b-e2') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d43789b-e2, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d43789b-e2, col_values=(('external_ids', {'iface-id': '8d43789b-e200-409a-b819-09dd85859b3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:a7:89', 'vm-uuid': '6b110aaa-0f26-4bab-8f3e-d22edb5a5072'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:41:56 user nova-compute[82196]: INFO os_vif [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a7:89,bridge_name='br-int',has_traffic_filtering=True,id=8d43789b-e200-409a-b819-09dd85859b3c,network=Network(41cb581c-8f02-42e0-ab09-bcc05d4aa23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d43789b-e2')
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No VIF found with MAC fa:16:3e:d3:a7:89, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG nova.network.neutron [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updated VIF entry in instance network info cache for port 8d43789b-e200-409a-b819-09dd85859b3c. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG nova.network.neutron [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updating instance_info_cache with network_info: [{"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf426c18-8566-4a1a-8e7f-9628ebe0467d req-c3486ea8-3d12-4665-b93b-bf7637d725ab service nova] Releasing lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:41:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242120.4463933, 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:42:00 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] VM Resumed (Lifecycle Event)
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-01bba42a-e544-4f91-8378-f5dfa8280284 req-7ee30039-a105-4a8a-8d06-19e8d79a3a73 service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Received event network-vif-plugged-8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-01bba42a-e544-4f91-8378-f5dfa8280284 req-7ee30039-a105-4a8a-8d06-19e8d79a3a73 service nova] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-01bba42a-e544-4f91-8378-f5dfa8280284 req-7ee30039-a105-4a8a-8d06-19e8d79a3a73 service nova] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-01bba42a-e544-4f91-8378-f5dfa8280284 req-7ee30039-a105-4a8a-8d06-19e8d79a3a73 service nova] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-01bba42a-e544-4f91-8378-f5dfa8280284 req-7ee30039-a105-4a8a-8d06-19e8d79a3a73 service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] No waiting events found dispatching network-vif-plugged-8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:42:00 user nova-compute[82196]: WARNING nova.compute.manager [req-01bba42a-e544-4f91-8378-f5dfa8280284 req-7ee30039-a105-4a8a-8d06-19e8d79a3a73 service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Received unexpected event network-vif-plugged-8d43789b-e200-409a-b819-09dd85859b3c for instance with vm_state building and task_state spawning.
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-b53645a2-b5fa-43f3-9343-c70086d65932 req-34ea37f0-f588-469a-af68-781269f32fbd service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Received event network-vif-plugged-8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b53645a2-b5fa-43f3-9343-c70086d65932 req-34ea37f0-f588-469a-af68-781269f32fbd service nova] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b53645a2-b5fa-43f3-9343-c70086d65932 req-34ea37f0-f588-469a-af68-781269f32fbd service nova] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b53645a2-b5fa-43f3-9343-c70086d65932 req-34ea37f0-f588-469a-af68-781269f32fbd service nova] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-b53645a2-b5fa-43f3-9343-c70086d65932 req-34ea37f0-f588-469a-af68-781269f32fbd service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] No waiting events found dispatching network-vif-plugged-8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:42:00 user nova-compute[82196]: WARNING nova.compute.manager [req-b53645a2-b5fa-43f3-9343-c70086d65932 req-34ea37f0-f588-469a-af68-781269f32fbd service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Received unexpected event network-vif-plugged-8d43789b-e200-409a-b819-09dd85859b3c for instance with vm_state building and task_state spawning.
Apr 11 19:42:00 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:42:00 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7807MB free_disk=26.052066802978516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:42:00 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Instance spawned successfully.
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:42:00 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242120.4484253, 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:42:00 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] VM Started (Lifecycle Event)
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:42:00 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance b079367a-558e-4920-ad8d-972a8065260c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bf0a75f5-2f44-4687-af12-046f6761fee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 0a59d114-20ac-448e-a95a-d3501c914833 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:42:00 user nova-compute[82196]: INFO nova.compute.manager [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Took 6.95 seconds to spawn the instance on the hypervisor.
Apr 11 19:42:00 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:42:01 user nova-compute[82196]: INFO nova.compute.manager [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Took 7.77 seconds to build instance.
Apr 11 19:42:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-f6de08be-f9ac-4e55-884a-d0ee71f21d9b tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.886s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:01 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:42:01 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:42:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:42:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:04 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:42:04 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:42:04 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:42:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:08 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242113.8242416, d42dc0ea-4631-44be-8b58-09877280ba2e => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:42:08 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] VM Stopped (Lifecycle Event)
Apr 11 19:42:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-c77d117a-a0d9-45d0-8cb1-3b4f632424b2 None None] [instance: d42dc0ea-4631-44be-8b58-09877280ba2e] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:42:09 user nova-compute[82196]: INFO nova.compute.manager [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Unrescuing
Apr 11 19:42:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:42:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquired lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:42:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:42:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updating instance_info_cache with network_info: [{"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:42:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Releasing lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:42:10 user nova-compute[82196]: DEBUG nova.objects.instance [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'flavor' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:42:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-56dc5eba-9edc-4618-8457-8141c8b17766 req-570ffb9c-d6d8-46f4-88e7-d399d1405c47 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-unplugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-56dc5eba-9edc-4618-8457-8141c8b17766 req-570ffb9c-d6d8-46f4-88e7-d399d1405c47 service nova] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-56dc5eba-9edc-4618-8457-8141c8b17766 req-570ffb9c-d6d8-46f4-88e7-d399d1405c47 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-56dc5eba-9edc-4618-8457-8141c8b17766 req-570ffb9c-d6d8-46f4-88e7-d399d1405c47 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-56dc5eba-9edc-4618-8457-8141c8b17766 req-570ffb9c-d6d8-46f4-88e7-d399d1405c47 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] No waiting events found dispatching network-vif-unplugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:42:10 user nova-compute[82196]: WARNING nova.compute.manager [req-56dc5eba-9edc-4618-8457-8141c8b17766 req-570ffb9c-d6d8-46f4-88e7-d399d1405c47 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received unexpected event network-vif-unplugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:42:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:10 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Instance destroyed successfully.
Apr 11 19:42:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] No waiting events found dispatching network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:42:12 user nova-compute[82196]: WARNING nova.compute.manager [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received unexpected event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:42:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] No waiting events found dispatching network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:42:12 user nova-compute[82196]: WARNING nova.compute.manager [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received unexpected event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:42:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] No waiting events found dispatching network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:42:12 user nova-compute[82196]: WARNING nova.compute.manager [req-345583c9-34f0-4c46-bcd7-99d811a77b4d req-0ab6d8b1-0380-4e76-9f7f-187844ebda01 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received unexpected event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance with vm_state rescued and task_state unrescuing.
Apr 11 19:42:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for bf0a75f5-2f44-4687-af12-046f6761fee2 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:42:14 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242134.441138, bf0a75f5-2f44-4687-af12-046f6761fee2 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:42:14 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] VM Resumed (Lifecycle Event)
Apr 11 19:42:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fa8aa12c-e3bf-47fa-ad7c-719164a0208f tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:42:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:42:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:42:14 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 19:42:14 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242134.4475195, bf0a75f5-2f44-4687-af12-046f6761fee2 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:42:14 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] VM Started (Lifecycle Event)
Apr 11 19:42:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:42:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:42:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Received event network-changed-41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:20 user nova-compute[82196]: DEBUG nova.compute.manager [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Refreshing instance network info cache due to event network-changed-41122899-3bba-4bdd-a114-61f342be91ae. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:42:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] Acquiring lock "refresh_cache-0a59d114-20ac-448e-a95a-d3501c914833" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:42:20 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] Acquired lock "refresh_cache-0a59d114-20ac-448e-a95a-d3501c914833" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:42:20 user nova-compute[82196]: DEBUG nova.network.neutron [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Refreshing network info cache for port 41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "0a59d114-20ac-448e-a95a-d3501c914833" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "0a59d114-20ac-448e-a95a-d3501c914833" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "0a59d114-20ac-448e-a95a-d3501c914833-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "0a59d114-20ac-448e-a95a-d3501c914833-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "0a59d114-20ac-448e-a95a-d3501c914833-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:21 user nova-compute[82196]: INFO nova.compute.manager [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Terminating instance
Apr 11 19:42:21 user nova-compute[82196]: DEBUG nova.compute.manager [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG nova.network.neutron [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Updated VIF entry in instance network info cache for port 41122899-3bba-4bdd-a114-61f342be91ae. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG nova.network.neutron [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Updating instance_info_cache with network_info: [{"id": "41122899-3bba-4bdd-a114-61f342be91ae", "address": "fa:16:3e:c5:aa:44", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41122899-3b", "ovs_interfaceid": "41122899-3bba-4bdd-a114-61f342be91ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a89e3cac-7810-4a2e-b6b7-4788a8e472d9 req-d8df495e-7602-4d81-9265-183bc03a74c7 service nova] Releasing lock "refresh_cache-0a59d114-20ac-448e-a95a-d3501c914833" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-fe5587be-f810-46f3-abbb-5c5180e3ac45 req-28df430f-f698-4370-9d03-2622b10a3022 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Received event network-vif-unplugged-41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fe5587be-f810-46f3-abbb-5c5180e3ac45 req-28df430f-f698-4370-9d03-2622b10a3022 service nova] Acquiring lock "0a59d114-20ac-448e-a95a-d3501c914833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fe5587be-f810-46f3-abbb-5c5180e3ac45 req-28df430f-f698-4370-9d03-2622b10a3022 service nova] Lock "0a59d114-20ac-448e-a95a-d3501c914833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fe5587be-f810-46f3-abbb-5c5180e3ac45 req-28df430f-f698-4370-9d03-2622b10a3022 service nova] Lock "0a59d114-20ac-448e-a95a-d3501c914833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-fe5587be-f810-46f3-abbb-5c5180e3ac45 req-28df430f-f698-4370-9d03-2622b10a3022 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] No waiting events found dispatching network-vif-unplugged-41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-fe5587be-f810-46f3-abbb-5c5180e3ac45 req-28df430f-f698-4370-9d03-2622b10a3022 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Received event network-vif-unplugged-41122899-3bba-4bdd-a114-61f342be91ae for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:42:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:22 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Instance destroyed successfully.
Apr 11 19:42:22 user nova-compute[82196]: DEBUG nova.objects.instance [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lazy-loading 'resources' on Instance uuid 0a59d114-20ac-448e-a95a-d3501c914833 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1799082805',display_name='tempest-TestVolumeBootPattern-server-1799082805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1799082805',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPal5dIOOTQX1AtimGkw05FO0Z9eaerqpiFYTxmlD5RcLLewnhLN4pAKWK7d0rX0zQgFYrr+JvrnM8AxIhiJUbrvnXCoFiGl5kaOegYnss1VivHpq7rMu1EVV1XJIRedHg==',key_name='tempest-TestVolumeBootPattern-1844027973',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-ogapa1it',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:40:40Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=0a59d114-20ac-448e-a95a-d3501c914833,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41122899-3bba-4bdd-a114-61f342be91ae", "address": "fa:16:3e:c5:aa:44", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41122899-3b", "ovs_interfaceid": "41122899-3bba-4bdd-a114-61f342be91ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "41122899-3bba-4bdd-a114-61f342be91ae", "address": "fa:16:3e:c5:aa:44", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41122899-3b", "ovs_interfaceid": "41122899-3bba-4bdd-a114-61f342be91ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=41122899-3bba-4bdd-a114-61f342be91ae,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41122899-3b') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_vif [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=41122899-3bba-4bdd-a114-61f342be91ae,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41122899-3b') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41122899-3b, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:22 user nova-compute[82196]: INFO os_vif [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=41122899-3bba-4bdd-a114-61f342be91ae,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41122899-3b')
Apr 11 19:42:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwEJArRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:42:22 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fe7605-a401-44d0-b983-4bc480fbdc5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:42:22 user nova-compute[82196]: No targets found.
Apr 11 19:42:22 user nova-compute[82196]: iSNS:
Apr 11 19:42:22 user nova-compute[82196]: No targets found.
Apr 11 19:42:22 user nova-compute[82196]: STATIC:
Apr 11 19:42:22 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:42:22 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:42:22 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:42:22 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037
Apr 11 19:42:22 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:42:22 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:42:22 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:42:22 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:42:22 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:42:22 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b
Apr 11 19:42:22 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:42:22 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:42:22 user nova-compute[82196]: FIRMWARE:
Apr 11 19:42:22 user nova-compute[82196]: No targets found.
Apr 11 19:42:22 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:42:22 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:42:22 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6086cb57-bfa7-4a93-821e-b95f536f5119]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d293ba78-60e2-49f7-909f-0ee3c9780890]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:42:22 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:42:22 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:42:22 user nova-compute[82196]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:42:22 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:42:22 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:42:22 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:42:22 user nova-compute[82196]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:42:22 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9240630ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037'): ({'sdd'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Removing single pathed devices sdd {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[df42a5d9-cbb8-4f91-9afb-4d5c2f131cfe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.035s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab5c633-4778-4df0-b9a8-5c72389fc6c6]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flushing IO for device /dev/sdd {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf82b6a-f206-4f88-b9c1-afbb582ad668]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[692f8f24-08a0-4a66-bf40-d7ccce727ecf]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOebe77146-80595509321a38a7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ebe77146', '/dev/disk/by-id/scsi-23830353935353039') {{(pid=91954) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f24f5a-1383-4a91-8431-ba88050968e8]: (4, None) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7d556b-b4d3-4b10-87a3-c48d1fc94157]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a88e911-a46c-44ed-8d93-77afb8aaaceb]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260]
Apr 11 19:42:22 user nova-compute[82196]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260] successful.
Apr 11 19:42:22 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d64a964-ebf0-4472-a7b3-aa0ec9cece1c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== disconnect_volume: return (418ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:42:22 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Deleting instance files /opt/stack/data/nova/instances/0a59d114-20ac-448e-a95a-d3501c914833_del
Apr 11 19:42:22 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Deletion of /opt/stack/data/nova/instances/0a59d114-20ac-448e-a95a-d3501c914833_del complete
Apr 11 19:42:22 user nova-compute[82196]: INFO nova.compute.manager [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Took 1.49 seconds to destroy the instance on the hypervisor.
Apr 11 19:42:22 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:42:22 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:42:23 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:42:23 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Took 0.92 seconds to deallocate network for instance.
Apr 11 19:42:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-219d0a54-29f2-42e9-8c0d-837b8af23304 req-811d5666-7b1c-4136-822d-2fd527a3b274 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Received event network-vif-deleted-41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-ade9cff6-1e90-442c-b4f8-cb00340d8bca req-52ec6275-7f80-4ed3-9562-65f38838c5a2 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Received event network-vif-plugged-41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ade9cff6-1e90-442c-b4f8-cb00340d8bca req-52ec6275-7f80-4ed3-9562-65f38838c5a2 service nova] Acquiring lock "0a59d114-20ac-448e-a95a-d3501c914833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ade9cff6-1e90-442c-b4f8-cb00340d8bca req-52ec6275-7f80-4ed3-9562-65f38838c5a2 service nova] Lock "0a59d114-20ac-448e-a95a-d3501c914833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ade9cff6-1e90-442c-b4f8-cb00340d8bca req-52ec6275-7f80-4ed3-9562-65f38838c5a2 service nova] Lock "0a59d114-20ac-448e-a95a-d3501c914833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-ade9cff6-1e90-442c-b4f8-cb00340d8bca req-52ec6275-7f80-4ed3-9562-65f38838c5a2 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] No waiting events found dispatching network-vif-plugged-41122899-3bba-4bdd-a114-61f342be91ae {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:42:23 user nova-compute[82196]: WARNING nova.compute.manager [req-ade9cff6-1e90-442c-b4f8-cb00340d8bca req-52ec6275-7f80-4ed3-9562-65f38838c5a2 service nova] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Received unexpected event network-vif-plugged-41122899-3bba-4bdd-a114-61f342be91ae for instance with vm_state active and task_state deleting.
Apr 11 19:42:24 user nova-compute[82196]: INFO nova.compute.manager [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Took 0.88 seconds to detach 1 volumes for instance.
Apr 11 19:42:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:24 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:42:24 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:42:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:24 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Deleted allocations for instance 0a59d114-20ac-448e-a95a-d3501c914833
Apr 11 19:42:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-d1447fab-fb8c-4722-bb42-7aae33b17589 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "0a59d114-20ac-448e-a95a-d3501c914833" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.766s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:32 user nova-compute[82196]: INFO nova.compute.manager [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Terminating instance
Apr 11 19:42:32 user nova-compute[82196]: DEBUG nova.compute.manager [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-9a1f733e-5c6c-48dc-b55e-68d1071e11b5 req-7f739710-3b3e-45ef-af16-6de9b43b54e0 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-unplugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9a1f733e-5c6c-48dc-b55e-68d1071e11b5 req-7f739710-3b3e-45ef-af16-6de9b43b54e0 service nova] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9a1f733e-5c6c-48dc-b55e-68d1071e11b5 req-7f739710-3b3e-45ef-af16-6de9b43b54e0 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9a1f733e-5c6c-48dc-b55e-68d1071e11b5 req-7f739710-3b3e-45ef-af16-6de9b43b54e0 service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-9a1f733e-5c6c-48dc-b55e-68d1071e11b5 req-7f739710-3b3e-45ef-af16-6de9b43b54e0 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] No waiting events found dispatching network-vif-unplugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG nova.compute.manager [req-9a1f733e-5c6c-48dc-b55e-68d1071e11b5 req-7f739710-3b3e-45ef-af16-6de9b43b54e0 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-unplugged-82ee2878-c477-419c-97ba-9ac4b36dacab for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Instance destroyed successfully.
Apr 11 19:42:33 user nova-compute[82196]: DEBUG nova.objects.instance [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'resources' on Instance uuid 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2051818305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2051818305',id=37,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:38:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-uoeaatrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:40:46Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=8c45de50-92bc-467c-9f3d-7e667e1d0bb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "82ee2878-c477-419c-97ba-9ac4b36dacab", "address": "fa:16:3e:27:09:60", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ee2878-c4", "ovs_interfaceid": "82ee2878-c477-419c-97ba-9ac4b36dacab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:09:60,bridge_name='br-int',has_traffic_filtering=True,id=82ee2878-c477-419c-97ba-9ac4b36dacab,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ee2878-c4') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_vif [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:09:60,bridge_name='br-int',has_traffic_filtering=True,id=82ee2878-c477-419c-97ba-9ac4b36dacab,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ee2878-c4') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82ee2878-c4, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:42:33 user nova-compute[82196]: INFO os_vif [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:09:60,bridge_name='br-int',has_traffic_filtering=True,id=82ee2878-c477-419c-97ba-9ac4b36dacab,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ee2878-c4')
Apr 11 19:42:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIifBHeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:42:33 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce03529-c2c9-429f-a88a-2d1f1f15c323]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:42:33 user nova-compute[82196]: No targets found.
Apr 11 19:42:33 user nova-compute[82196]: iSNS:
Apr 11 19:42:33 user nova-compute[82196]: No targets found.
Apr 11 19:42:33 user nova-compute[82196]: STATIC:
Apr 11 19:42:33 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:42:33 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:42:33 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:42:33 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8
Apr 11 19:42:33 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:42:33 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:42:33 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b
Apr 11 19:42:33 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:42:33 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:42:33 user nova-compute[82196]: FIRMWARE:
Apr 11 19:42:33 user nova-compute[82196]: No targets found.
Apr 11 19:42:33 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:42:33 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:42:33 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c5aabc-9390-4469-8144-d57eee31f7cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbbe753-1cae-4c9d-bf41-bedb3b3d7d9a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:42:33 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:42:33 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:42:33 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:42:33 user nova-compute[82196]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 (non-flash)
Apr 11 19:42:33 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:42:33 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9240630f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8'): ({'sdi'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Removing single pathed devices sdi {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaf69a0-59af-4342-87c7-0a9ade3c9001]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[65921788-2128-4f7a-9384-ef9f1d8c0bbd]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flushing IO for device /dev/sdi {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b208be-28f7-46b0-bc7c-1f68aa14e423]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.050s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3503663c-3114-4b97-9266-4f861786f112]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] SCSI volumes sdi have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23733643532346666', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e3790886', '/dev/disk/by-id/scsi-1SCST_BIOe3790886-73d524ff96476816') {{(pid=91954) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ffdcee-21d6-49e4-af4c-7017a423ec35]: (4, None) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[08af4dd8-eb3c-40d7-aff5-66aaa38422f9]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c95d7d3-fce8-4bd6-a2d0-167bbc01c895]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8, portal: 172.16.0.220,3260]
Apr 11 19:42:33 user nova-compute[82196]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8, portal: 172.16.0.220,3260] successful.
Apr 11 19:42:33 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13194fc-7f97-44b9-afa8-9380e7358af8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e59e0b7-ac81-41ea-a1fc-cc51a9ee8daf]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] <== disconnect_volume: return (309ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:42:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Deleting instance files /opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3_del
Apr 11 19:42:33 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Deletion of /opt/stack/data/nova/instances/8c45de50-92bc-467c-9f3d-7e667e1d0bb3_del complete
Apr 11 19:42:33 user nova-compute[82196]: INFO nova.compute.manager [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 11 19:42:33 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:42:33 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Took 0.45 seconds to deallocate network for instance.
Apr 11 19:42:33 user nova-compute[82196]: DEBUG nova.compute.manager [req-81bc9b28-4a64-4389-b681-5663110bf3b8 req-051363cd-a202-4f42-a277-d2262abf3ce3 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-deleted-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:33 user nova-compute[82196]: INFO nova.compute.manager [req-81bc9b28-4a64-4389-b681-5663110bf3b8 req-051363cd-a202-4f42-a277-d2262abf3ce3 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Neutron deleted interface 82ee2878-c477-419c-97ba-9ac4b36dacab; detaching it from the instance and deleting it from the info cache
Apr 11 19:42:33 user nova-compute[82196]: DEBUG nova.network.neutron [req-81bc9b28-4a64-4389-b681-5663110bf3b8 req-051363cd-a202-4f42-a277-d2262abf3ce3 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:42:33 user nova-compute[82196]: DEBUG nova.compute.manager [req-81bc9b28-4a64-4389-b681-5663110bf3b8 req-051363cd-a202-4f42-a277-d2262abf3ce3 service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Detach interface failed, port_id=82ee2878-c477-419c-97ba-9ac4b36dacab, reason: Instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:42:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-3e45516e-3eb7-4122-aa71-b9f57156de79 req-a80c32b4-36b7-42f1-a204-c99033de096e service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3e45516e-3eb7-4122-aa71-b9f57156de79 req-a80c32b4-36b7-42f1-a204-c99033de096e service nova] Acquiring lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3e45516e-3eb7-4122-aa71-b9f57156de79 req-a80c32b4-36b7-42f1-a204-c99033de096e service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3e45516e-3eb7-4122-aa71-b9f57156de79 req-a80c32b4-36b7-42f1-a204-c99033de096e service nova] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:34 user nova-compute[82196]: DEBUG nova.compute.manager [req-3e45516e-3eb7-4122-aa71-b9f57156de79 req-a80c32b4-36b7-42f1-a204-c99033de096e service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] No waiting events found dispatching network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:42:34 user nova-compute[82196]: WARNING nova.compute.manager [req-3e45516e-3eb7-4122-aa71-b9f57156de79 req-a80c32b4-36b7-42f1-a204-c99033de096e service nova] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Received unexpected event network-vif-plugged-82ee2878-c477-419c-97ba-9ac4b36dacab for instance with vm_state active and task_state deleting.
Apr 11 19:42:34 user nova-compute[82196]: INFO nova.compute.manager [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Took 0.79 seconds to detach 1 volumes for instance.
Apr 11 19:42:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:34 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:35 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:42:35 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:42:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:35 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Deleted allocations for instance 8c45de50-92bc-467c-9f3d-7e667e1d0bb3
Apr 11 19:42:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:35 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-85ea411b-a26a-4eb2-bd73-e2abf4382fcf tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "8c45de50-92bc-467c-9f3d-7e667e1d0bb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.868s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:37 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242142.054911, 0a59d114-20ac-448e-a95a-d3501c914833 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:42:37 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] VM Stopped (Lifecycle Event)
Apr 11 19:42:37 user nova-compute[82196]: DEBUG nova.compute.manager [None req-c3c9af5d-eadf-4a29-8a7f-62683f587e23 None None] [instance: 0a59d114-20ac-448e-a95a-d3501c914833] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:42:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:42:43 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:42:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:47 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:42:47 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:42:48 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242153.0660443, 8c45de50-92bc-467c-9f3d-7e667e1d0bb3 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:42:48 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] VM Stopped (Lifecycle Event)
Apr 11 19:42:48 user nova-compute[82196]: DEBUG nova.compute.manager [None req-820cc0d6-d087-4eb8-a5aa-ddee849d354b None None] [instance: 8c45de50-92bc-467c-9f3d-7e667e1d0bb3] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:42:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:48 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:42:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:50 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:42:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:42:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:42:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:42:50 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:42:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updating instance_info_cache with network_info: [{"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:42:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:42:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:42:52 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:42:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:53 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:42:56 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:42:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:42:56 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:42:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Received event network-changed-91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Refreshing instance network info cache due to event network-changed-91ef79db-4548-423d-9022-b88dd7608438. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] Acquiring lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] Acquired lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.network.neutron [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Refreshing network info cache for port 91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:42:59 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:42:59 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7923MB free_disk=26.047500610351562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance b079367a-558e-4920-ad8d-972a8065260c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bf0a75f5-2f44-4687-af12-046f6761fee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing inventories for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Updating ProviderTree inventory for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Updating inventory in ProviderTree for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing aggregate associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, aggregates: None {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 19:42:59 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing trait associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 19:43:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:00 user nova-compute[82196]: DEBUG nova.network.neutron [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Updated VIF entry in instance network info cache for port 91ef79db-4548-423d-9022-b88dd7608438. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:43:00 user nova-compute[82196]: DEBUG nova.network.neutron [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Updating instance_info_cache with network_info: [{"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:43:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-40451d13-a55a-4df7-a7d7-0bb1e0fd1f09 req-3432855d-fd46-41f4-8912-f2d28c2cdfc5 service nova] Releasing lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:43:00 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:43:00 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:43:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:43:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.692s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:01 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:43:01 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:43:01 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:43:01 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:43:01 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82196) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:43:02 user nova-compute[82196]: INFO nova.compute.claims [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Claim successful on node user
Apr 11 19:43:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] There are 0 instances to clean {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:43:02 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:43:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:43:02 user nova-compute[82196]: INFO nova.virt.block_device [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Booting with volume 8cc8ee09-43bc-4887-ad61-c9f10b5f487d at /dev/vda
Apr 11 19:43:02 user nova-compute[82196]: DEBUG os_brick.utils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:02 user nova-compute[82196]: DEBUG nova.policy [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05fb551c320a48f98a4ec00a7f7492d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a7381a31b84e97a068528f90813773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba61449-ba54-451a-a7eb-43d81bb76c95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[66241ff1-9e99-4101-9922-dd6bcffd679a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81deb24-0abd-40ef-af32-01b762239a63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da78141-df64-43f3-a9a9-0d9de632977d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:43:03 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:43:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3871453f-b499-4455-8c0c-cf8c14ce65e2]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG os_brick.utils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updating existing volume attachment record: f63954c7-ff07-4ac8-988e-73db92b47fbc {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:43:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:04 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Successfully created port: c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:43:04 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Successfully updated port: c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:43:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:43:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquired lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:43:04 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:43:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received event network-changed-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Refreshing instance network info cache due to event network-changed-c3ef7018-189c-423e-b92b-b2b4a98dafce. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:43:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] Acquiring lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:43:05 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:43:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:05 user nova-compute[82196]: DEBUG nova.network.neutron [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updating instance_info_cache with network_info: [{"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:43:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Releasing lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:43:05 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Instance network_info: |[{"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:43:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] Acquired lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:43:05 user nova-compute[82196]: DEBUG nova.network.neutron [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Refreshing network info cache for port c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:43:05 user nova-compute[82196]: DEBUG nova.network.neutron [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updated VIF entry in instance network info cache for port c3ef7018-189c-423e-b92b-b2b4a98dafce. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:43:05 user nova-compute[82196]: DEBUG nova.network.neutron [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updating instance_info_cache with network_info: [{"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:43:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-f48ca453-fb56-4b98-a76d-677f2046a123 req-d50f86eb-1876-46e5-b313-9ed56b553946 service nova] Releasing lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:43:07 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Creating image(s)
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Ensure instance console log exists: /opt/stack/data/nova/instances/f633037d-87d0-4dda-aa33-3cc9c3191080/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Start _get_guest_xml network_info=[{"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipgYEafu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f633037d-87d0-4dda-aa33-3cc9c3191080', 'attached_at': '', 'detached_at': '', 'volume_id': '8cc8ee09-43bc-4887-ad61-c9f10b5f487d', 'serial': '8cc8ee09-43bc-4887-ad61-c9f10b5f487d'}, 'attachment_id': 'f63954c7-ff07-4ac8-988e-73db92b47fbc', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:43:07 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:43:07 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipgYEafu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:43:07 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:43:07 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:43:07 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[83df58c0-5deb-4845-9a8a-4aa80197b3ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:43:07 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a76237-85c0-4c86-9746-7bf45f4eaece]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d] added
Apr 11 19:43:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de77b6e-0b4c-4361-84ca-ded5b48defa4]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[571f20be-cb4a-4b48-940b-d692fb35a79d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipgYEafu {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipgYEafu" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd050e0e-98ac-473c-9955-d14e103c6190]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ipgYEafu'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc887fd5-3060-4d8b-8c66-c4aa8b0ba58a]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9399d66b-6e52-44cb-a320-d4eecc9ca1f7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:43:07 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:43:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:43:07 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:43:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d23effc-e4f9-4d8b-866b-f281936ca7d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260]
Apr 11 19:43:07 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260] successful.
Apr 11 19:43:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[91388b68-1290-4c9b-90bf-6475aa86e3aa]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc129b2-7ff5-41b2-8226-6f18dd47c132]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:43:07 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:43:07 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:43:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:43:07 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:43:07 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:43:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4784a7f4-bb1d-47af-8b65-e12cb9f04ef5]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:07 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipgYEafu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26566366539353030', 'path': '/dev/sdc'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566366539353030', 'path': '/dev/sdc'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2146974288',display_name='tempest-ServerActionsTestJSON-server-2146974288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2146974288',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-2nw0xxm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:43:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=f633037d-87d0-4dda-aa33-3cc9c3191080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG nova.objects.instance [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'pci_devices' on Instance uuid f633037d-87d0-4dda-aa33-3cc9c3191080 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:43:08 user nova-compute[82196]:   <uuid>f633037d-87d0-4dda-aa33-3cc9c3191080</uuid>
Apr 11 19:43:08 user nova-compute[82196]:   <name>instance-0000002a</name>
Apr 11 19:43:08 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:43:08 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:43:08 user nova-compute[82196]:   <metadata>
Apr 11 19:43:08 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:43:08 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:43:08 user nova-compute[82196]:       <nova:name>tempest-ServerActionsTestJSON-server-2146974288</nova:name>
Apr 11 19:43:08 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:43:07</nova:creationTime>
Apr 11 19:43:08 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:43:08 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:43:08 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:43:08 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:43:08 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:43:08 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:43:08 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:43:08 user nova-compute[82196]:       <nova:owner>
Apr 11 19:43:08 user nova-compute[82196]:         <nova:user uuid="05fb551c320a48f98a4ec00a7f7492d7">tempest-ServerActionsTestJSON-37730514-project-member</nova:user>
Apr 11 19:43:08 user nova-compute[82196]:         <nova:project uuid="60a7381a31b84e97a068528f90813773">tempest-ServerActionsTestJSON-37730514</nova:project>
Apr 11 19:43:08 user nova-compute[82196]:       </nova:owner>
Apr 11 19:43:08 user nova-compute[82196]:       <nova:ports>
Apr 11 19:43:08 user nova-compute[82196]:         <nova:port uuid="c3ef7018-189c-423e-b92b-b2b4a98dafce">
Apr 11 19:43:08 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 19:43:08 user nova-compute[82196]:         </nova:port>
Apr 11 19:43:08 user nova-compute[82196]:       </nova:ports>
Apr 11 19:43:08 user nova-compute[82196]:     </nova:instance>
Apr 11 19:43:08 user nova-compute[82196]:   </metadata>
Apr 11 19:43:08 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:43:08 user nova-compute[82196]:     <system>
Apr 11 19:43:08 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:43:08 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:43:08 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:43:08 user nova-compute[82196]:       <entry name="serial">f633037d-87d0-4dda-aa33-3cc9c3191080</entry>
Apr 11 19:43:08 user nova-compute[82196]:       <entry name="uuid">f633037d-87d0-4dda-aa33-3cc9c3191080</entry>
Apr 11 19:43:08 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:43:08 user nova-compute[82196]:     </system>
Apr 11 19:43:08 user nova-compute[82196]:   </sysinfo>
Apr 11 19:43:08 user nova-compute[82196]:   <os>
Apr 11 19:43:08 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:43:08 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:43:08 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:43:08 user nova-compute[82196]:   </os>
Apr 11 19:43:08 user nova-compute[82196]:   <features>
Apr 11 19:43:08 user nova-compute[82196]:     <acpi/>
Apr 11 19:43:08 user nova-compute[82196]:     <apic/>
Apr 11 19:43:08 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:43:08 user nova-compute[82196]:   </features>
Apr 11 19:43:08 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:43:08 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:43:08 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:43:08 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:43:08 user nova-compute[82196]:   </clock>
Apr 11 19:43:08 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:43:08 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:43:08 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:43:08 user nova-compute[82196]:   </cpu>
Apr 11 19:43:08 user nova-compute[82196]:   <devices>
Apr 11 19:43:08 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:43:08 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:43:08 user nova-compute[82196]:       <source dev="/dev/sdc"/>
Apr 11 19:43:08 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:43:08 user nova-compute[82196]:       <serial>8cc8ee09-43bc-4887-ad61-c9f10b5f487d</serial>
Apr 11 19:43:08 user nova-compute[82196]:     </disk>
Apr 11 19:43:08 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:43:08 user nova-compute[82196]:       <mac address="fa:16:3e:38:36:1c"/>
Apr 11 19:43:08 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:43:08 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:43:08 user nova-compute[82196]:       <target dev="tapc3ef7018-18"/>
Apr 11 19:43:08 user nova-compute[82196]:     </interface>
Apr 11 19:43:08 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:43:08 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/f633037d-87d0-4dda-aa33-3cc9c3191080/console.log" append="off"/>
Apr 11 19:43:08 user nova-compute[82196]:     </serial>
Apr 11 19:43:08 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:43:08 user nova-compute[82196]:     <video>
Apr 11 19:43:08 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:43:08 user nova-compute[82196]:     </video>
Apr 11 19:43:08 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:43:08 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:43:08 user nova-compute[82196]:     </rng>
Apr 11 19:43:08 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:43:08 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:43:08 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:43:08 user nova-compute[82196]:     </memballoon>
Apr 11 19:43:08 user nova-compute[82196]:   </devices>
Apr 11 19:43:08 user nova-compute[82196]: </domain>
Apr 11 19:43:08 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2146974288',display_name='tempest-ServerActionsTestJSON-server-2146974288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2146974288',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-2nw0xxm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:43:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=f633037d-87d0-4dda-aa33-3cc9c3191080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG os_vif [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3ef7018-18, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3ef7018-18, col_values=(('external_ids', {'iface-id': 'c3ef7018-189c-423e-b92b-b2b4a98dafce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:36:1c', 'vm-uuid': 'f633037d-87d0-4dda-aa33-3cc9c3191080'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:08 user nova-compute[82196]: INFO os_vif [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18')
Apr 11 19:43:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:43:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No VIF found with MAC fa:16:3e:38:36:1c, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:43:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce1ea699-f8d2-4816-84b3-2dffc075d329 req-9c2a96c8-39b5-4b1e-b1cd-a5094dc55755 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received event network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce1ea699-f8d2-4816-84b3-2dffc075d329 req-9c2a96c8-39b5-4b1e-b1cd-a5094dc55755 service nova] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce1ea699-f8d2-4816-84b3-2dffc075d329 req-9c2a96c8-39b5-4b1e-b1cd-a5094dc55755 service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce1ea699-f8d2-4816-84b3-2dffc075d329 req-9c2a96c8-39b5-4b1e-b1cd-a5094dc55755 service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce1ea699-f8d2-4816-84b3-2dffc075d329 req-9c2a96c8-39b5-4b1e-b1cd-a5094dc55755 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] No waiting events found dispatching network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:43:10 user nova-compute[82196]: WARNING nova.compute.manager [req-ce1ea699-f8d2-4816-84b3-2dffc075d329 req-9c2a96c8-39b5-4b1e-b1cd-a5094dc55755 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received unexpected event network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce for instance with vm_state building and task_state spawning.
Apr 11 19:43:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242192.155793, f633037d-87d0-4dda-aa33-3cc9c3191080 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:43:12 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] VM Resumed (Lifecycle Event)
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:43:12 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Instance spawned successfully.
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:43:12 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242192.1570148, f633037d-87d0-4dda-aa33-3cc9c3191080 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:43:12 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] VM Started (Lifecycle Event)
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:43:12 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:43:12 user nova-compute[82196]: INFO nova.compute.manager [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Took 5.00 seconds to spawn the instance on the hypervisor.
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-b656ce58-630f-476b-a9cc-e253b380c522 req-69e7c141-3c9a-4ade-8ee2-22d538f234ac service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received event network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b656ce58-630f-476b-a9cc-e253b380c522 req-69e7c141-3c9a-4ade-8ee2-22d538f234ac service nova] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b656ce58-630f-476b-a9cc-e253b380c522 req-69e7c141-3c9a-4ade-8ee2-22d538f234ac service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b656ce58-630f-476b-a9cc-e253b380c522 req-69e7c141-3c9a-4ade-8ee2-22d538f234ac service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-b656ce58-630f-476b-a9cc-e253b380c522 req-69e7c141-3c9a-4ade-8ee2-22d538f234ac service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] No waiting events found dispatching network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:43:12 user nova-compute[82196]: WARNING nova.compute.manager [req-b656ce58-630f-476b-a9cc-e253b380c522 req-69e7c141-3c9a-4ade-8ee2-22d538f234ac service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received unexpected event network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce for instance with vm_state building and task_state spawning.
Apr 11 19:43:12 user nova-compute[82196]: INFO nova.compute.manager [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Took 10.03 seconds to build instance.
Apr 11 19:43:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2587da74-19c1-41d6-8b0f-ba0b89303bb1 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.153s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a66c1d51-e194-424d-a37c-d308544774c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a66c1d51-e194-424d-a37c-d308544774c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:43:13 user nova-compute[82196]: INFO nova.compute.claims [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Claim successful on node user
Apr 11 19:43:13 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:43:13 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:43:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:43:13 user nova-compute[82196]: INFO nova.virt.block_device [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Booting with volume af3920bc-0034-4875-be3a-b25fe27ee037 at /dev/vda
Apr 11 19:43:13 user nova-compute[82196]: DEBUG nova.policy [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG os_brick.utils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f7020f-08a0-4bd1-9b2a-c95def4e888a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf025d1-a78d-40f9-9bfa-92d3affe628f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7ed0c1-43f7-4fe2-8937-77fa176934fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[87765618-dcdd-4f4d-b3a5-b6b720cb79af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:43:13 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:43:13 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c08653-f793-49e9-af24-e882a09c2428]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG os_brick.utils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:43:13 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Updating existing volume attachment record: e9f47e57-bb28-41e8-8701-3e304a6546ba {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:43:14 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Successfully created port: 397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Successfully updated port: 397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "refresh_cache-a66c1d51-e194-424d-a37c-d308544774c6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquired lock "refresh_cache-a66c1d51-e194-424d-a37c-d308544774c6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Received event network-changed-397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Refreshing instance network info cache due to event network-changed-397ebb82-45b3-41ad-bbac-ef07140bf942. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] Acquiring lock "refresh_cache-a66c1d51-e194-424d-a37c-d308544774c6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG nova.network.neutron [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Updating instance_info_cache with network_info: [{"id": "397ebb82-45b3-41ad-bbac-ef07140bf942", "address": "fa:16:3e:33:3a:fc", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ebb82-45", "ovs_interfaceid": "397ebb82-45b3-41ad-bbac-ef07140bf942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Releasing lock "refresh_cache-a66c1d51-e194-424d-a37c-d308544774c6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Instance network_info: |[{"id": "397ebb82-45b3-41ad-bbac-ef07140bf942", "address": "fa:16:3e:33:3a:fc", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ebb82-45", "ovs_interfaceid": "397ebb82-45b3-41ad-bbac-ef07140bf942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] Acquired lock "refresh_cache-a66c1d51-e194-424d-a37c-d308544774c6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG nova.network.neutron [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Refreshing network info cache for port 397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG nova.network.neutron [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Updated VIF entry in instance network info cache for port 397ebb82-45b3-41ad-bbac-ef07140bf942. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG nova.network.neutron [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Updating instance_info_cache with network_info: [{"id": "397ebb82-45b3-41ad-bbac-ef07140bf942", "address": "fa:16:3e:33:3a:fc", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ebb82-45", "ovs_interfaceid": "397ebb82-45b3-41ad-bbac-ef07140bf942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:43:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3412b735-5f1e-40a3-b907-e08ca6dfdbd2 req-8b392c64-405a-4fd2-a53b-3a58249c3100 service nova] Releasing lock "refresh_cache-a66c1d51-e194-424d-a37c-d308544774c6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:43:18 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Creating image(s)
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Ensure instance console log exists: /opt/stack/data/nova/instances/a66c1d51-e194-424d-a37c-d308544774c6/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Start _get_guest_xml network_info=[{"id": "397ebb82-45b3-41ad-bbac-ef07140bf942", "address": "fa:16:3e:33:3a:fc", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ebb82-45", "ovs_interfaceid": "397ebb82-45b3-41ad-bbac-ef07140bf942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwEJArRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a66c1d51-e194-424d-a37c-d308544774c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'af3920bc-0034-4875-be3a-b25fe27ee037', 'serial': 'af3920bc-0034-4875-be3a-b25fe27ee037'}, 'attachment_id': 'e9f47e57-bb28-41e8-8701-3e304a6546ba', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:43:18 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:43:18 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwEJArRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:43:18 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:43:18 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:43:18 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0979fa86-8dc6-40a1-b863-c9be7998b3d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:43:18 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8333dd11-570a-4262-9a38-b2385965fa01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037] added
Apr 11 19:43:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f044b7-293c-4727-8be0-45a7c49bd854]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f738542-a195-4f30-84b7-574d5029957f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwEJArRC {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwEJArRC" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f810cdb1-6329-41c3-83cb-cd7023b0b499]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iwEJArRC'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc14794-4739-49b2-b7df-ac51447e89f7]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bab9aa-8347-4406-b0f8-548ab6bd2bbe]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:43:18 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:43:18 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:43:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:43:18 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:43:18 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:43:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5870dae7-f858-4736-a943-91b4f85dec70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260]
Apr 11 19:43:18 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260] successful.
Apr 11 19:43:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[391d64a7-5563-4a4f-8817-c56c6083ab3e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b38baec-7873-4e81-9e83-55983f58039b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:43:18 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:43:18 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:43:18 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:43:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:43:18 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:43:18 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:43:18 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:43:18 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dd2612-43af-4579-a9dc-1f4b39c67a81]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwEJArRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:43:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23830353935353039', 'path': '/dev/sdd'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830353935353039', 'path': '/dev/sdd'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-189754775',display_name='tempest-TestVolumeBootPattern-server-189754775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-189754775',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPal5dIOOTQX1AtimGkw05FO0Z9eaerqpiFYTxmlD5RcLLewnhLN4pAKWK7d0rX0zQgFYrr+JvrnM8AxIhiJUbrvnXCoFiGl5kaOegYnss1VivHpq7rMu1EVV1XJIRedHg==',key_name='tempest-TestVolumeBootPattern-1844027973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-8jw46fry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:43:14Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=a66c1d51-e194-424d-a37c-d308544774c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "397ebb82-45b3-41ad-bbac-ef07140bf942", "address": "fa:16:3e:33:3a:fc", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ebb82-45", "ovs_interfaceid": "397ebb82-45b3-41ad-bbac-ef07140bf942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "397ebb82-45b3-41ad-bbac-ef07140bf942", "address": "fa:16:3e:33:3a:fc", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ebb82-45", "ovs_interfaceid": "397ebb82-45b3-41ad-bbac-ef07140bf942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:3a:fc,bridge_name='br-int',has_traffic_filtering=True,id=397ebb82-45b3-41ad-bbac-ef07140bf942,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ebb82-45') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lazy-loading 'pci_devices' on Instance uuid a66c1d51-e194-424d-a37c-d308544774c6 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:43:19 user nova-compute[82196]:   <uuid>a66c1d51-e194-424d-a37c-d308544774c6</uuid>
Apr 11 19:43:19 user nova-compute[82196]:   <name>instance-0000002b</name>
Apr 11 19:43:19 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:43:19 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:43:19 user nova-compute[82196]:   <metadata>
Apr 11 19:43:19 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:43:19 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:43:19 user nova-compute[82196]:       <nova:name>tempest-TestVolumeBootPattern-server-189754775</nova:name>
Apr 11 19:43:19 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:43:18</nova:creationTime>
Apr 11 19:43:19 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:43:19 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:43:19 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:43:19 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:43:19 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:43:19 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:43:19 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:43:19 user nova-compute[82196]:       <nova:owner>
Apr 11 19:43:19 user nova-compute[82196]:         <nova:user uuid="cf262cd03f4a41c4956d8784cf37d86d">tempest-TestVolumeBootPattern-935343500-project-member</nova:user>
Apr 11 19:43:19 user nova-compute[82196]:         <nova:project uuid="2caba0618fc743e7bfb2dd866a511df9">tempest-TestVolumeBootPattern-935343500</nova:project>
Apr 11 19:43:19 user nova-compute[82196]:       </nova:owner>
Apr 11 19:43:19 user nova-compute[82196]:       <nova:ports>
Apr 11 19:43:19 user nova-compute[82196]:         <nova:port uuid="397ebb82-45b3-41ad-bbac-ef07140bf942">
Apr 11 19:43:19 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 19:43:19 user nova-compute[82196]:         </nova:port>
Apr 11 19:43:19 user nova-compute[82196]:       </nova:ports>
Apr 11 19:43:19 user nova-compute[82196]:     </nova:instance>
Apr 11 19:43:19 user nova-compute[82196]:   </metadata>
Apr 11 19:43:19 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:43:19 user nova-compute[82196]:     <system>
Apr 11 19:43:19 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:43:19 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:43:19 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:43:19 user nova-compute[82196]:       <entry name="serial">a66c1d51-e194-424d-a37c-d308544774c6</entry>
Apr 11 19:43:19 user nova-compute[82196]:       <entry name="uuid">a66c1d51-e194-424d-a37c-d308544774c6</entry>
Apr 11 19:43:19 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:43:19 user nova-compute[82196]:     </system>
Apr 11 19:43:19 user nova-compute[82196]:   </sysinfo>
Apr 11 19:43:19 user nova-compute[82196]:   <os>
Apr 11 19:43:19 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:43:19 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:43:19 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:43:19 user nova-compute[82196]:   </os>
Apr 11 19:43:19 user nova-compute[82196]:   <features>
Apr 11 19:43:19 user nova-compute[82196]:     <acpi/>
Apr 11 19:43:19 user nova-compute[82196]:     <apic/>
Apr 11 19:43:19 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:43:19 user nova-compute[82196]:   </features>
Apr 11 19:43:19 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:43:19 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:43:19 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:43:19 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:43:19 user nova-compute[82196]:   </clock>
Apr 11 19:43:19 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:43:19 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:43:19 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:43:19 user nova-compute[82196]:   </cpu>
Apr 11 19:43:19 user nova-compute[82196]:   <devices>
Apr 11 19:43:19 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:43:19 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:43:19 user nova-compute[82196]:       <source dev="/dev/sdd"/>
Apr 11 19:43:19 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:43:19 user nova-compute[82196]:       <serial>af3920bc-0034-4875-be3a-b25fe27ee037</serial>
Apr 11 19:43:19 user nova-compute[82196]:     </disk>
Apr 11 19:43:19 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:43:19 user nova-compute[82196]:       <mac address="fa:16:3e:33:3a:fc"/>
Apr 11 19:43:19 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:43:19 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:43:19 user nova-compute[82196]:       <target dev="tap397ebb82-45"/>
Apr 11 19:43:19 user nova-compute[82196]:     </interface>
Apr 11 19:43:19 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:43:19 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/a66c1d51-e194-424d-a37c-d308544774c6/console.log" append="off"/>
Apr 11 19:43:19 user nova-compute[82196]:     </serial>
Apr 11 19:43:19 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:43:19 user nova-compute[82196]:     <video>
Apr 11 19:43:19 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:43:19 user nova-compute[82196]:     </video>
Apr 11 19:43:19 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:43:19 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:43:19 user nova-compute[82196]:     </rng>
Apr 11 19:43:19 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:43:19 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:43:19 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:43:19 user nova-compute[82196]:     </memballoon>
Apr 11 19:43:19 user nova-compute[82196]:   </devices>
Apr 11 19:43:19 user nova-compute[82196]: </domain>
Apr 11 19:43:19 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-189754775',display_name='tempest-TestVolumeBootPattern-server-189754775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-189754775',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPal5dIOOTQX1AtimGkw05FO0Z9eaerqpiFYTxmlD5RcLLewnhLN4pAKWK7d0rX0zQgFYrr+JvrnM8AxIhiJUbrvnXCoFiGl5kaOegYnss1VivHpq7rMu1EVV1XJIRedHg==',key_name='tempest-TestVolumeBootPattern-1844027973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-8jw46fry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:43:14Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=a66c1d51-e194-424d-a37c-d308544774c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "397ebb82-45b3-41ad-bbac-ef07140bf942", "address": "fa:16:3e:33:3a:fc", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ebb82-45", "ovs_interfaceid": "397ebb82-45b3-41ad-bbac-ef07140bf942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "397ebb82-45b3-41ad-bbac-ef07140bf942", "address": "fa:16:3e:33:3a:fc", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ebb82-45", "ovs_interfaceid": "397ebb82-45b3-41ad-bbac-ef07140bf942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:3a:fc,bridge_name='br-int',has_traffic_filtering=True,id=397ebb82-45b3-41ad-bbac-ef07140bf942,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ebb82-45') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG os_vif [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:3a:fc,bridge_name='br-int',has_traffic_filtering=True,id=397ebb82-45b3-41ad-bbac-ef07140bf942,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ebb82-45') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap397ebb82-45, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap397ebb82-45, col_values=(('external_ids', {'iface-id': '397ebb82-45b3-41ad-bbac-ef07140bf942', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:3a:fc', 'vm-uuid': 'a66c1d51-e194-424d-a37c-d308544774c6'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:19 user nova-compute[82196]: INFO os_vif [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:3a:fc,bridge_name='br-int',has_traffic_filtering=True,id=397ebb82-45b3-41ad-bbac-ef07140bf942,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ebb82-45')
Apr 11 19:43:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:43:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] No VIF found with MAC fa:16:3e:33:3a:fc, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:43:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-bdee2580-d295-4777-817b-9e5e1892b98a req-f1e08a7b-4fd3-45a1-aa57-05d6a872651d service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Received event network-vif-plugged-397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bdee2580-d295-4777-817b-9e5e1892b98a req-f1e08a7b-4fd3-45a1-aa57-05d6a872651d service nova] Acquiring lock "a66c1d51-e194-424d-a37c-d308544774c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bdee2580-d295-4777-817b-9e5e1892b98a req-f1e08a7b-4fd3-45a1-aa57-05d6a872651d service nova] Lock "a66c1d51-e194-424d-a37c-d308544774c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bdee2580-d295-4777-817b-9e5e1892b98a req-f1e08a7b-4fd3-45a1-aa57-05d6a872651d service nova] Lock "a66c1d51-e194-424d-a37c-d308544774c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-bdee2580-d295-4777-817b-9e5e1892b98a req-f1e08a7b-4fd3-45a1-aa57-05d6a872651d service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] No waiting events found dispatching network-vif-plugged-397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:43:21 user nova-compute[82196]: WARNING nova.compute.manager [req-bdee2580-d295-4777-817b-9e5e1892b98a req-f1e08a7b-4fd3-45a1-aa57-05d6a872651d service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Received unexpected event network-vif-plugged-397ebb82-45b3-41ad-bbac-ef07140bf942 for instance with vm_state building and task_state spawning.
Apr 11 19:43:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "b079367a-558e-4920-ad8d-972a8065260c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "b079367a-558e-4920-ad8d-972a8065260c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "b079367a-558e-4920-ad8d-972a8065260c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:23 user nova-compute[82196]: INFO nova.compute.manager [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Terminating instance
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.compute.manager [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242203.2699125, a66c1d51-e194-424d-a37c-d308544774c6 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:43:23 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a66c1d51-e194-424d-a37c-d308544774c6] VM Resumed (Lifecycle Event)
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-0e859726-02df-4f59-9b94-2a42d3313a9a req-ad5708d0-25ec-404a-a3db-b70b83c7ce4b service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Received event network-vif-plugged-397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0e859726-02df-4f59-9b94-2a42d3313a9a req-ad5708d0-25ec-404a-a3db-b70b83c7ce4b service nova] Acquiring lock "a66c1d51-e194-424d-a37c-d308544774c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0e859726-02df-4f59-9b94-2a42d3313a9a req-ad5708d0-25ec-404a-a3db-b70b83c7ce4b service nova] Lock "a66c1d51-e194-424d-a37c-d308544774c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0e859726-02df-4f59-9b94-2a42d3313a9a req-ad5708d0-25ec-404a-a3db-b70b83c7ce4b service nova] Lock "a66c1d51-e194-424d-a37c-d308544774c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-0e859726-02df-4f59-9b94-2a42d3313a9a req-ad5708d0-25ec-404a-a3db-b70b83c7ce4b service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] No waiting events found dispatching network-vif-plugged-397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:43:23 user nova-compute[82196]: WARNING nova.compute.manager [req-0e859726-02df-4f59-9b94-2a42d3313a9a req-ad5708d0-25ec-404a-a3db-b70b83c7ce4b service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Received unexpected event network-vif-plugged-397ebb82-45b3-41ad-bbac-ef07140bf942 for instance with vm_state building and task_state spawning.
Apr 11 19:43:23 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Instance spawned successfully.
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:43:23 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a66c1d51-e194-424d-a37c-d308544774c6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242203.2717636, a66c1d51-e194-424d-a37c-d308544774c6 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:43:23 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a66c1d51-e194-424d-a37c-d308544774c6] VM Started (Lifecycle Event)
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:43:23 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: a66c1d51-e194-424d-a37c-d308544774c6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce56e9c8-0641-472a-a637-bad38a8baa1e req-4976c9d4-da48-4762-8de0-b86487cd572f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received event network-vif-unplugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce56e9c8-0641-472a-a637-bad38a8baa1e req-4976c9d4-da48-4762-8de0-b86487cd572f service nova] Acquiring lock "b079367a-558e-4920-ad8d-972a8065260c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce56e9c8-0641-472a-a637-bad38a8baa1e req-4976c9d4-da48-4762-8de0-b86487cd572f service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce56e9c8-0641-472a-a637-bad38a8baa1e req-4976c9d4-da48-4762-8de0-b86487cd572f service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce56e9c8-0641-472a-a637-bad38a8baa1e req-4976c9d4-da48-4762-8de0-b86487cd572f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] No waiting events found dispatching network-vif-unplugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce56e9c8-0641-472a-a637-bad38a8baa1e req-4976c9d4-da48-4762-8de0-b86487cd572f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received event network-vif-unplugged-54168103-37cf-4abe-a4e5-bac3eeeca578 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:43:23 user nova-compute[82196]: INFO nova.compute.manager [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Took 5.29 seconds to spawn the instance on the hypervisor.
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:23 user nova-compute[82196]: INFO nova.compute.manager [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Took 10.60 seconds to build instance.
Apr 11 19:43:23 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a704a3a5-f1d3-4b59-a1f6-c616c0bc2011 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a66c1d51-e194-424d-a37c-d308544774c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.728s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:23 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: b079367a-558e-4920-ad8d-972a8065260c] Instance destroyed successfully.
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.objects.instance [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'resources' on Instance uuid b079367a-558e-4920-ad8d-972a8065260c {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1965367859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1965367859',id=31,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:34:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-csx0nx90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:35:58Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=b079367a-558e-4920-ad8d-972a8065260c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54168103-37cf-4abe-a4e5-bac3eeeca578", "address": "fa:16:3e:29:d3:5a", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54168103-37", "ovs_interfaceid": "54168103-37cf-4abe-a4e5-bac3eeeca578", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "54168103-37cf-4abe-a4e5-bac3eeeca578", "address": "fa:16:3e:29:d3:5a", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54168103-37", "ovs_interfaceid": "54168103-37cf-4abe-a4e5-bac3eeeca578", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:d3:5a,bridge_name='br-int',has_traffic_filtering=True,id=54168103-37cf-4abe-a4e5-bac3eeeca578,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54168103-37') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG os_vif [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:d3:5a,bridge_name='br-int',has_traffic_filtering=True,id=54168103-37cf-4abe-a4e5-bac3eeeca578,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54168103-37') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54168103-37, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:43:23 user nova-compute[82196]: INFO os_vif [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:d3:5a,bridge_name='br-int',has_traffic_filtering=True,id=54168103-37cf-4abe-a4e5-bac3eeeca578,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54168103-37')
Apr 11 19:43:23 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Deleting instance files /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c_del
Apr 11 19:43:23 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Deletion of /opt/stack/data/nova/instances/b079367a-558e-4920-ad8d-972a8065260c_del complete
Apr 11 19:43:24 user nova-compute[82196]: INFO nova.compute.manager [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: b079367a-558e-4920-ad8d-972a8065260c] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 11 19:43:24 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:43:24 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: b079367a-558e-4920-ad8d-972a8065260c] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:43:24 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: b079367a-558e-4920-ad8d-972a8065260c] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:43:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:24 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: b079367a-558e-4920-ad8d-972a8065260c] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:43:24 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: b079367a-558e-4920-ad8d-972a8065260c] Took 0.68 seconds to deallocate network for instance.
Apr 11 19:43:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:24 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:25 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Deleted allocations for instance b079367a-558e-4920-ad8d-972a8065260c
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-b6808995-7d91-4ecf-af18-ebb1b443f274 tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "b079367a-558e-4920-ad8d-972a8065260c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.198s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-a4f461d1-b220-4907-a1e5-65955eac9408 req-8fb4c0bf-4c0d-4d77-8144-eb7492a23fa6 service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received event network-vif-deleted-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received event network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Acquiring lock "b079367a-558e-4920-ad8d-972a8065260c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] No waiting events found dispatching network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:43:25 user nova-compute[82196]: WARNING nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received unexpected event network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 for instance with vm_state deleted and task_state None.
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received event network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Acquiring lock "b079367a-558e-4920-ad8d-972a8065260c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] No waiting events found dispatching network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:43:25 user nova-compute[82196]: WARNING nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received unexpected event network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 for instance with vm_state deleted and task_state None.
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received event network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Acquiring lock "b079367a-558e-4920-ad8d-972a8065260c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] No waiting events found dispatching network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:43:25 user nova-compute[82196]: WARNING nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received unexpected event network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 for instance with vm_state deleted and task_state None.
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received event network-vif-unplugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Acquiring lock "b079367a-558e-4920-ad8d-972a8065260c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] No waiting events found dispatching network-vif-unplugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:43:25 user nova-compute[82196]: WARNING nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received unexpected event network-vif-unplugged-54168103-37cf-4abe-a4e5-bac3eeeca578 for instance with vm_state deleted and task_state None.
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received event network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Acquiring lock "b079367a-558e-4920-ad8d-972a8065260c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] Lock "b079367a-558e-4920-ad8d-972a8065260c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:25 user nova-compute[82196]: DEBUG nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] No waiting events found dispatching network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:43:25 user nova-compute[82196]: WARNING nova.compute.manager [req-ce2da7be-8bc6-4f0a-959e-62c24aced79e req-e0c727ad-1ae9-4146-b78e-ce43e764a46f service nova] [instance: b079367a-558e-4920-ad8d-972a8065260c] Received unexpected event network-vif-plugged-54168103-37cf-4abe-a4e5-bac3eeeca578 for instance with vm_state deleted and task_state None.
Apr 11 19:43:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:38 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242203.8037133, b079367a-558e-4920-ad8d-972a8065260c => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:43:38 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: b079367a-558e-4920-ad8d-972a8065260c] VM Stopped (Lifecycle Event)
Apr 11 19:43:38 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ffbd91e2-6315-4a9d-a011-2c832f0aabb4 None None] [instance: b079367a-558e-4920-ad8d-972a8065260c] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:43:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Received event network-changed-8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:43:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Refreshing instance network info cache due to event network-changed-8d43789b-e200-409a-b819-09dd85859b3c. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:43:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] Acquiring lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:43:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] Acquired lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:43:46 user nova-compute[82196]: DEBUG nova.network.neutron [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Refreshing network info cache for port 8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updated VIF entry in instance network info cache for port 8d43789b-e200-409a-b819-09dd85859b3c. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updating instance_info_cache with network_info: [{"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG nova.objects.instance [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'flavor' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-624bc961-ab97-4da3-a4bd-f29a6a8efeed req-bb5b0c65-ae92-4f44-8901-3b9900dcb5bc service nova] Releasing lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:47 user nova-compute[82196]: INFO nova.compute.manager [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attaching volume fddbfb90-1352-42e7-bb50-aa2c83c2e019 to /dev/vdb
Apr 11 19:43:47 user nova-compute[82196]: DEBUG os_brick.utils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[118449c3-cf93-445c-98a7-ea82268caaf2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a14945a-3adb-41ae-8660-e4b6148e6b9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91e8502-fc02-4f8a-8bce-5dcacffe0159]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[271208ab-c1f0-4e0e-baf5-cf193fbd4527]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:43:47 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:43:47 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5b073a-d445-47da-a74a-3db909404c04]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG os_brick.utils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:43:47 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updating existing volume attachment record: dd2ad5d9-dfd3-4ff5-9307-cf02cfbc9fd8 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:43:48 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:43:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:49 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:43:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxNebhsy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:43:52 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:43:52 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:43:52 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41ae9be-98ff-42c3-8964-5d528238ed96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:43:52 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d270db1f-00c3-4164-96ae-5d3eaf3d9f7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019] added
Apr 11 19:43:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55eb29b-ccd1-4775-a805-7401787b4e84]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa2292e-331d-4339-81f5-ed4f3a108b48]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UxNebhsy {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UxNebhsy" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e876ec92-64c2-43dd-856a-e257163ef6be]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UxNebhsy'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e0ea28-8036-4190-9e20-8846c96dcf1e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d2e90a-93a8-4a8a-a43a-10786e279950]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:43:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:43:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15e358f-afbb-4deb-a03c-90f505315f3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019, portal: 172.16.0.220,3260]
Apr 11 19:43:52 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019, portal: 172.16.0.220,3260] successful.
Apr 11 19:43:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdf0580-61e3-4480-a53a-3512dadccbc1]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc20c94e-61a1-496e-bc0d-f2de72317d7a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 (non-flash)
Apr 11 19:43:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:43:52 user nova-compute[82196]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 (non-flash)
Apr 11 19:43:52 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3207fcb0-a419-45f9-bb8e-70b7e377dda8]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxNebhsy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:43:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Updating instance_info_cache with network_info: [{"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-6f2616ce-4924-4b82-996a-2596ae8856a4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23538313039306364', 'path': '/dev/sdf'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538313039306364', 'path': '/dev/sdf'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG nova.objects.instance [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'flavor' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:43:53 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:43:53 user nova-compute[82196]:   <source dev="/dev/sdf"/>
Apr 11 19:43:53 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:43:53 user nova-compute[82196]:   <serial>fddbfb90-1352-42e7-bb50-aa2c83c2e019</serial>
Apr 11 19:43:53 user nova-compute[82196]: </disk>
Apr 11 19:43:53 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No VIF found with MAC fa:16:3e:d3:a7:89, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-617e9a18-a108-47a4-962a-2b520b6f4be9 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.263s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:54 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:43:54 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:43:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:57 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:43:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:43:57 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:43:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:43:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:43:59 user nova-compute[82196]: INFO nova.compute.manager [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Detaching volume fddbfb90-1352-42e7-bb50-aa2c83c2e019
Apr 11 19:43:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:43:59 user nova-compute[82196]: INFO nova.virt.block_device [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attempting to driver detach volume fddbfb90-1352-42e7-bb50-aa2c83c2e019 from mountpoint /dev/vdb
Apr 11 19:43:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Attempting to detach device vdb from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:43:59 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:43:59 user nova-compute[82196]:   <source dev="/dev/sdf"/>
Apr 11 19:43:59 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:43:59 user nova-compute[82196]:   <serial>fddbfb90-1352-42e7-bb50-aa2c83c2e019</serial>
Apr 11 19:43:59 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:43:59 user nova-compute[82196]: </disk>
Apr 11 19:43:59 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:43:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Successfully detached device vdb from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the persistent domain config.
Apr 11 19:43:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:43:59 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:43:59 user nova-compute[82196]:   <source dev="/dev/sdf"/>
Apr 11 19:43:59 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:43:59 user nova-compute[82196]:   <serial>fddbfb90-1352-42e7-bb50-aa2c83c2e019</serial>
Apr 11 19:43:59 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:43:59 user nova-compute[82196]: </disk>
Apr 11 19:43:59 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:43:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681242240.0804036, 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:44:00 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Successfully detached device vdb from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the live domain config.
Apr 11 19:44:00 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:44:00 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=7812MB free_disk=26.127079010009766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxNebhsy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:44:00 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed21dfb9-d6c5-4001-83e0-14f22687b864]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:44:00 user nova-compute[82196]: No targets found.
Apr 11 19:44:00 user nova-compute[82196]: iSNS:
Apr 11 19:44:00 user nova-compute[82196]: No targets found.
Apr 11 19:44:00 user nova-compute[82196]: STATIC:
Apr 11 19:44:00 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:44:00 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:00 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:00 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d
Apr 11 19:44:00 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:00 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:00 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037
Apr 11 19:44:00 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:00 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:00 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b
Apr 11 19:44:00 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:00 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:00 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019
Apr 11 19:44:00 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:00 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:00 user nova-compute[82196]: FIRMWARE:
Apr 11 19:44:00 user nova-compute[82196]: No targets found.
Apr 11 19:44:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:44:00 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:44:00 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fa95b3-b67c-42b0-9f9a-f1afd00cb280]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cbf364-0cce-428e-9dd8-c6434200b1ff]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:44:00 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:44:00 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:44:00 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:44:00 user nova-compute[82196]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 (non-flash)
Apr 11 19:44:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:44:00 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:44:00 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:44:00 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:44:00 user nova-compute[82196]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 (non-flash)
Apr 11 19:44:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9240482d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019'): ({'sdf'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Removing single pathed devices sdf {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37965fa-7700-4cf5-926b-90a0995f3fe7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03bc679-960f-49ad-a43f-af05f3535e5d]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Flushing IO for device /dev/sdf {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance bf0a75f5-2f44-4687-af12-046f6761fee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance f633037d-87d0-4dda-aa33-3cc9c3191080 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance a66c1d51-e194-424d-a37c-d308544774c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a771da06-ebfd-4e12-9e4d-0f892fcce4eb]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[282fc94c-4747-48ad-bd7e-01606357cf4d]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] SCSI volumes sdf have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[be35d590-097e-4f23-8a64-013ce68eb759]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c567a2d8-55d6-4f88-bdc7-68e8a44721d2]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019, portal: 172.16.0.220,3260]
Apr 11 19:44:00 user nova-compute[82196]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019, portal: 172.16.0.220,3260] successful.
Apr 11 19:44:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddbfb90-1352-42e7-bb50-aa2c83c2e019 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[522ccc7f-0e8d-4219-93e8-bb3e7200d696]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] <== disconnect_volume: return (357ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:44:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG nova.compute.manager [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-changed-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG nova.compute.manager [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Refreshing instance network info cache due to event network-changed-c662b1b3-b2b3-4502-81af-9afdf3e591dc. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] Acquiring lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] Acquired lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG nova.network.neutron [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Refreshing network info cache for port c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG nova.objects.instance [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'flavor' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2e766d84-4145-4ba5-8093-263a7797b0e3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.965s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:01 user nova-compute[82196]: INFO nova.compute.manager [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Detaching volume 6cb60e75-74d9-4e1f-a22e-40a36780b21b
Apr 11 19:44:01 user nova-compute[82196]: INFO nova.virt.block_device [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Attempting to driver detach volume 6cb60e75-74d9-4e1f-a22e-40a36780b21b from mountpoint /dev/vdb
Apr 11 19:44:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Attempting to detach device vdb from instance bf0a75f5-2f44-4687-af12-046f6761fee2 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:44:01 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:44:01 user nova-compute[82196]:   <source dev="/dev/sde"/>
Apr 11 19:44:01 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:44:01 user nova-compute[82196]:   <serial>6cb60e75-74d9-4e1f-a22e-40a36780b21b</serial>
Apr 11 19:44:01 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:44:01 user nova-compute[82196]: </disk>
Apr 11 19:44:01 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:44:01 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Successfully detached device vdb from instance bf0a75f5-2f44-4687-af12-046f6761fee2 from the persistent domain config.
Apr 11 19:44:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf0a75f5-2f44-4687-af12-046f6761fee2 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:44:01 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:44:01 user nova-compute[82196]:   <source dev="/dev/sde"/>
Apr 11 19:44:01 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:44:01 user nova-compute[82196]:   <serial>6cb60e75-74d9-4e1f-a22e-40a36780b21b</serial>
Apr 11 19:44:01 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:44:01 user nova-compute[82196]: </disk>
Apr 11 19:44:01 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG nova.network.neutron [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updated VIF entry in instance network info cache for port c662b1b3-b2b3-4502-81af-9afdf3e591dc. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG nova.network.neutron [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updating instance_info_cache with network_info: [{"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:44:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ba4263ea-5e96-4de5-bf12-2311c629744c req-c437ff2b-51e2-4f88-9fdc-57c5b304c0a8 service nova] Releasing lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681242242.234124, bf0a75f5-2f44-4687-af12-046f6761fee2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:44:02 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Successfully detached device vdb from instance bf0a75f5-2f44-4687-af12-046f6761fee2 from the live domain config.
Apr 11 19:44:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnVDWZAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:44:02 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d6a306-d27b-4815-813e-e7a4a631765a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:44:02 user nova-compute[82196]: No targets found.
Apr 11 19:44:02 user nova-compute[82196]: iSNS:
Apr 11 19:44:02 user nova-compute[82196]: No targets found.
Apr 11 19:44:02 user nova-compute[82196]: STATIC:
Apr 11 19:44:02 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:44:02 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:02 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:02 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d
Apr 11 19:44:02 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:02 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:02 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037
Apr 11 19:44:02 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:02 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:02 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b
Apr 11 19:44:02 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:02 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:02 user nova-compute[82196]: FIRMWARE:
Apr 11 19:44:02 user nova-compute[82196]: No targets found.
Apr 11 19:44:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:44:02 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:44:02 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada0c341-a176-44fd-97e4-6d8a1b0d0a8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[78273877-94a9-46a5-83c6-8f4815988db1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:44:02 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:44:02 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:44:02 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:44:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:44:02 user nova-compute[82196]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b (non-flash)
Apr 11 19:44:02 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:44:02 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:44:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9240481b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b'): ({'sde'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Removing single pathed devices sde {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5218f829-fcac-4b9e-a692-8deeebcf22a4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[59eee524-1632-447c-856d-3a2f1ae7b9df]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Flushing IO for device /dev/sde {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a74e55-fe5b-4caf-aec3-6ce113cf412d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[537fe073-18ed-4a81-b0a0-c8b15597917f]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] SCSI volumes sde have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[098aa540-5db5-4f82-9b1a-459e5e30f059]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9175867-f635-48bd-9e5b-e8de9e9ffd7e]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b, portal: 172.16.0.220,3260]
Apr 11 19:44:02 user nova-compute[82196]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b, portal: 172.16.0.220,3260] successful.
Apr 11 19:44:02 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb60e75-74d9-4e1f-a22e-40a36780b21b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ed3174-9a9c-488b-a7a7-db7f40f04448]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] <== disconnect_volume: return (318ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:44:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:44:03 user nova-compute[82196]: DEBUG nova.objects.instance [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'flavor' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:44:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-48d1caf3-af61-40fd-9ee4-e3d28f607e96 tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.655s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:03 user nova-compute[82196]: DEBUG nova.compute.manager [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-changed-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:44:03 user nova-compute[82196]: DEBUG nova.compute.manager [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Refreshing instance network info cache due to event network-changed-c662b1b3-b2b3-4502-81af-9afdf3e591dc. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:44:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] Acquiring lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:44:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] Acquired lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:44:03 user nova-compute[82196]: DEBUG nova.network.neutron [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Refreshing network info cache for port c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:44:03 user nova-compute[82196]: DEBUG nova.network.neutron [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updated VIF entry in instance network info cache for port c662b1b3-b2b3-4502-81af-9afdf3e591dc. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:44:03 user nova-compute[82196]: DEBUG nova.network.neutron [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updating instance_info_cache with network_info: [{"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:44:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-6d6afc04-4be8-441d-aecd-92318ce341a7 req-9ff83c25-6a5a-41b0-8902-3b0f3eb7c7e1 service nova] Releasing lock "refresh_cache-bf0a75f5-2f44-4687-af12-046f6761fee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:44:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:13 user nova-compute[82196]: INFO nova.compute.manager [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Terminating instance
Apr 11 19:44:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-ab28b17b-4883-4963-915e-a7eced32b17d req-dc337a70-52a0-40af-aaba-fe3d36238bc6 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-unplugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ab28b17b-4883-4963-915e-a7eced32b17d req-dc337a70-52a0-40af-aaba-fe3d36238bc6 service nova] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ab28b17b-4883-4963-915e-a7eced32b17d req-dc337a70-52a0-40af-aaba-fe3d36238bc6 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ab28b17b-4883-4963-915e-a7eced32b17d req-dc337a70-52a0-40af-aaba-fe3d36238bc6 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-ab28b17b-4883-4963-915e-a7eced32b17d req-dc337a70-52a0-40af-aaba-fe3d36238bc6 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] No waiting events found dispatching network-vif-unplugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG nova.compute.manager [req-ab28b17b-4883-4963-915e-a7eced32b17d req-dc337a70-52a0-40af-aaba-fe3d36238bc6 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-unplugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:14 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Instance destroyed successfully.
Apr 11 19:44:14 user nova-compute[82196]: DEBUG nova.objects.instance [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'resources' on Instance uuid 864fcd9b-8e5b-4de8-a2e6-292a8907a834 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2079796435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2079796435',id=23,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:30:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-v6h0cyai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:32:16Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=864fcd9b-8e5b-4de8-a2e6-292a8907a834,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "address": "fa:16:3e:db:2d:10", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f272b0-f7", "ovs_interfaceid": "60f272b0-f7d2-408b-b99b-9bcfcd3f23ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:2d:10,bridge_name='br-int',has_traffic_filtering=True,id=60f272b0-f7d2-408b-b99b-9bcfcd3f23ff,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f272b0-f7') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_vif [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:2d:10,bridge_name='br-int',has_traffic_filtering=True,id=60f272b0-f7d2-408b-b99b-9bcfcd3f23ff,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f272b0-f7') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60f272b0-f7, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:44:14 user nova-compute[82196]: INFO os_vif [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:2d:10,bridge_name='br-int',has_traffic_filtering=True,id=60f272b0-f7d2-408b-b99b-9bcfcd3f23ff,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f272b0-f7')
Apr 11 19:44:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBQxmzcq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:44:14 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21d4583-a781-4eee-831a-a931c468e7a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:44:14 user nova-compute[82196]: No targets found.
Apr 11 19:44:14 user nova-compute[82196]: iSNS:
Apr 11 19:44:14 user nova-compute[82196]: No targets found.
Apr 11 19:44:14 user nova-compute[82196]: STATIC:
Apr 11 19:44:14 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21
Apr 11 19:44:14 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:14 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:14 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d
Apr 11 19:44:14 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:14 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:14 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037
Apr 11 19:44:14 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:14 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:14 user nova-compute[82196]: FIRMWARE:
Apr 11 19:44:14 user nova-compute[82196]: No targets found.
Apr 11 19:44:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:44:14 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:44:14 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc9515e-8e3e-47fa-a8d4-df06d443766c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[759cd390-9738-4c42-bbc7-6db85b29ef7b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:44:14 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:44:14 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:44:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 (non-flash)
Apr 11 19:44:14 user nova-compute[82196]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:44:14 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:44:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92641c2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21'): ({'sdb'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Removing single pathed devices sdb {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7abd237-77c3-44f9-96ae-da1a6cea908b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ed39ec-ea9d-4c82-b507-7886441930a8]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Flushing IO for device /dev/sdb {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe7604d-c7ae-4bc3-9300-2fbad0683a05]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[59301955-1ba3-4dec-a012-e7a5441e47df]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[26594b1a-6d42-4c92-bece-cd4506a51734]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc87cc2-dc0e-41c2-8e8d-29007776d5cb]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21, portal: 172.16.0.220,3260]
Apr 11 19:44:14 user nova-compute[82196]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21, portal: 172.16.0.220,3260] successful.
Apr 11 19:44:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c16a921-5f10-4a87-bd7c-2be0654eea21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2667c31e-74d4-406f-82a9-038791768687]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] <== disconnect_volume: return (316ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:44:14 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Deleting instance files /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834_del
Apr 11 19:44:14 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Deletion of /opt/stack/data/nova/instances/864fcd9b-8e5b-4de8-a2e6-292a8907a834_del complete
Apr 11 19:44:14 user nova-compute[82196]: INFO nova.compute.manager [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 11 19:44:14 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:44:14 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:44:15 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:44:15 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Took 0.52 seconds to deallocate network for instance.
Apr 11 19:44:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-72182481-4b62-4b89-ad00-a6f7e6f67142 req-e20fa4ec-0081-469e-8b37-1b372aa99afb service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-deleted-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:44:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-2294e617-ea14-4a2a-8121-8cb3662ecb7e req-79472b61-164c-4c31-abe9-3d0395c8d027 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:44:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2294e617-ea14-4a2a-8121-8cb3662ecb7e req-79472b61-164c-4c31-abe9-3d0395c8d027 service nova] Acquiring lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2294e617-ea14-4a2a-8121-8cb3662ecb7e req-79472b61-164c-4c31-abe9-3d0395c8d027 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2294e617-ea14-4a2a-8121-8cb3662ecb7e req-79472b61-164c-4c31-abe9-3d0395c8d027 service nova] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-2294e617-ea14-4a2a-8121-8cb3662ecb7e req-79472b61-164c-4c31-abe9-3d0395c8d027 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] No waiting events found dispatching network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:44:15 user nova-compute[82196]: WARNING nova.compute.manager [req-2294e617-ea14-4a2a-8121-8cb3662ecb7e req-79472b61-164c-4c31-abe9-3d0395c8d027 service nova] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Received unexpected event network-vif-plugged-60f272b0-f7d2-408b-b99b-9bcfcd3f23ff for instance with vm_state active and task_state deleting.
Apr 11 19:44:16 user nova-compute[82196]: INFO nova.compute.manager [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Took 0.77 seconds to detach 1 volumes for instance.
Apr 11 19:44:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:16 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:44:16 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:44:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:16 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Deleted allocations for instance 864fcd9b-8e5b-4de8-a2e6-292a8907a834
Apr 11 19:44:16 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-86723e45-d1f4-4694-ba38-5ff461e88d4f tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "864fcd9b-8e5b-4de8-a2e6-292a8907a834" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.925s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:29 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242254.3234873, 864fcd9b-8e5b-4de8-a2e6-292a8907a834 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:44:29 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] VM Stopped (Lifecycle Event)
Apr 11 19:44:29 user nova-compute[82196]: DEBUG nova.compute.manager [None req-daf897ef-93b6-465d-bfce-e3c4c65f0de7 None None] [instance: 864fcd9b-8e5b-4de8-a2e6-292a8907a834] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:44:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:44:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:44:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:44:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:44:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:48 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:44:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:49 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:44:50 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG nova.objects.instance [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'flavor' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:51 user nova-compute[82196]: INFO nova.compute.manager [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attaching volume 873005bd-7295-415c-b38f-2b5d07bca963 to /dev/vdb
Apr 11 19:44:51 user nova-compute[82196]: DEBUG os_brick.utils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b3d65f-9ab9-4729-98f1-15fbfc7ed684]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3978f9-7b38-4daf-a8ed-837abe4de705]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4d7f24-8a27-4ab1-b488-32752f891f6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fef76f8-08ca-4737-bc42-fd3ffa999d2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:44:51 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:44:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e80e08-8773-415f-938e-547bee7ac264]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG os_brick.utils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:44:51 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updating existing volume attachment record: e070404b-40a0-4671-9058-5b53ebef4bcc {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:52 user nova-compute[82196]: INFO nova.compute.manager [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Terminating instance
Apr 11 19:44:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-0c537dee-51ce-483a-821d-d7603b50de5e req-bc48195e-5662-4479-8cce-cb9558cfc8c4 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-unplugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0c537dee-51ce-483a-821d-d7603b50de5e req-bc48195e-5662-4479-8cce-cb9558cfc8c4 service nova] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0c537dee-51ce-483a-821d-d7603b50de5e req-bc48195e-5662-4479-8cce-cb9558cfc8c4 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-0c537dee-51ce-483a-821d-d7603b50de5e req-bc48195e-5662-4479-8cce-cb9558cfc8c4 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-0c537dee-51ce-483a-821d-d7603b50de5e req-bc48195e-5662-4479-8cce-cb9558cfc8c4 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] No waiting events found dispatching network-vif-unplugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-0c537dee-51ce-483a-821d-d7603b50de5e req-bc48195e-5662-4479-8cce-cb9558cfc8c4 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-unplugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Instance destroyed successfully.
Apr 11 19:44:52 user nova-compute[82196]: DEBUG nova.objects.instance [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'resources' on Instance uuid bf0a75f5-2f44-4687-af12-046f6761fee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1910984367',display_name='tempest-ServerRescueNegativeTestJSON-server-1910984367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1910984367',id=38,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOg6Hf94pVltDkkNWWRUkyDdm5FkHOFas15WTV4ELfursaPozu4TbpoIUk0HP0VHxjYdcQgsc8wfNgH6fYZasAgDxzJ8ujV0YM5uYIVaN2C0LA5O+gHU06Xkv+AxumfVcw==',key_name='tempest-keypair-1079379697',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8e3a291c54b49db8e12a88ba41865e3',ramdisk_id='',reservation_id='r-m984i7hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1429831687',owner_user_name='tempest-ServerRescueNegativeTestJSON-1429831687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:42:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba7f82b529e74d99838b6264b94d823b',uuid=bf0a75f5-2f44-4687-af12-046f6761fee2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converting VIF {"id": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "address": "fa:16:3e:16:43:8c", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc662b1b3-b2", "ovs_interfaceid": "c662b1b3-b2b3-4502-81af-9afdf3e591dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:43:8c,bridge_name='br-int',has_traffic_filtering=True,id=c662b1b3-b2b3-4502-81af-9afdf3e591dc,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc662b1b3-b2') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG os_vif [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:43:8c,bridge_name='br-int',has_traffic_filtering=True,id=c662b1b3-b2b3-4502-81af-9afdf3e591dc,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc662b1b3-b2') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc662b1b3-b2, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:52 user nova-compute[82196]: INFO os_vif [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:43:8c,bridge_name='br-int',has_traffic_filtering=True,id=c662b1b3-b2b3-4502-81af-9afdf3e591dc,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc662b1b3-b2')
Apr 11 19:44:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Deleting instance files /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2_del
Apr 11 19:44:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Deletion of /opt/stack/data/nova/instances/bf0a75f5-2f44-4687-af12-046f6761fee2_del complete
Apr 11 19:44:52 user nova-compute[82196]: INFO nova.compute.manager [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 19:44:52 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:44:52 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:44:53 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:44:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:44:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Skipping network cache update for instance because it is being deleted. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9841}}
Apr 11 19:44:53 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Didn't find any instances for network info cache update. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 19:44:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Received event network-changed-91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:44:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Refreshing instance network info cache due to event network-changed-91ef79db-4548-423d-9022-b88dd7608438. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:44:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] Acquiring lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:44:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] Acquired lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:44:53 user nova-compute[82196]: DEBUG nova.network.neutron [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Refreshing network info cache for port 91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:44:54 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:44:54 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Took 1.09 seconds to deallocate network for instance.
Apr 11 19:44:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:54 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:44:54 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:44:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-c5fc07fd-0737-42e0-a3fe-060d56dfe553 req-fa9fad0b-ee73-4d2e-8f05-3e42717c6680 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:44:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c5fc07fd-0737-42e0-a3fe-060d56dfe553 req-fa9fad0b-ee73-4d2e-8f05-3e42717c6680 service nova] Acquiring lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c5fc07fd-0737-42e0-a3fe-060d56dfe553 req-fa9fad0b-ee73-4d2e-8f05-3e42717c6680 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-c5fc07fd-0737-42e0-a3fe-060d56dfe553 req-fa9fad0b-ee73-4d2e-8f05-3e42717c6680 service nova] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:54 user nova-compute[82196]: DEBUG nova.compute.manager [req-c5fc07fd-0737-42e0-a3fe-060d56dfe553 req-fa9fad0b-ee73-4d2e-8f05-3e42717c6680 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] No waiting events found dispatching network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:44:54 user nova-compute[82196]: WARNING nova.compute.manager [req-c5fc07fd-0737-42e0-a3fe-060d56dfe553 req-fa9fad0b-ee73-4d2e-8f05-3e42717c6680 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received unexpected event network-vif-plugged-c662b1b3-b2b3-4502-81af-9afdf3e591dc for instance with vm_state deleted and task_state None.
Apr 11 19:44:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Updated VIF entry in instance network info cache for port 91ef79db-4548-423d-9022-b88dd7608438. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:44:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Updating instance_info_cache with network_info: [{"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:44:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b860e793-ce52-48ba-86c3-eae4faa70acf req-0df15f67-1676-4cfd-927f-046eb795cab2 service nova] Releasing lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:44:54 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Deleted allocations for instance bf0a75f5-2f44-4687-af12-046f6761fee2
Apr 11 19:44:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-84525690-5d3a-4ed2-9c11-d2f00141f29c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "bf0a75f5-2f44-4687-af12-046f6761fee2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.533s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Stashing vm_state: active {{(pid=82196) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG nova.objects.instance [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'pci_requests' on Instance uuid f633037d-87d0-4dda-aa33-3cc9c3191080 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:44:55 user nova-compute[82196]: INFO nova.compute.claims [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Claim successful on node user
Apr 11 19:44:55 user nova-compute[82196]: DEBUG nova.objects.instance [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'resources' on Instance uuid f633037d-87d0-4dda-aa33-3cc9c3191080 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG nova.objects.instance [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'pci_devices' on Instance uuid f633037d-87d0-4dda-aa33-3cc9c3191080 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:44:55 user nova-compute[82196]: INFO nova.compute.resource_tracker [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updating resource usage from migration 3839b6ea-9b2e-4f67-9730-ef911fd3ecfb
Apr 11 19:44:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received event network-changed-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Refreshing instance network info cache due to event network-changed-c3ef7018-189c-423e-b92b-b2b4a98dafce. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] Acquiring lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] Acquired lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG nova.network.neutron [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Refreshing network info cache for port c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:44:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.383s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:55 user nova-compute[82196]: INFO nova.compute.manager [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Migrating
Apr 11 19:44:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCmMyean', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:44:56 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:44:56 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:44:56 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c974e73-0656-4a44-9701-0779a828c833]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:44:56 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cca546-16f2-4705-a911-341d21867c08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963] added
Apr 11 19:44:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac7df85-4e0b-45b8-9456-815554bfdfb2]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5349cb-49c5-4754-8db1-52e1b2bff0db]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCmMyean {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCmMyean" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a0cdfc-276f-4992-8014-182de1a157e2]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XCmMyean'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[898df18c-73f3-4ca5-8897-b92016c3f2ba]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2b1c4d-4dbc-408c-bb87-b58bf9f72a88]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:44:56 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:44:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:44:56 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:44:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b50af05-1242-4e7f-a398-c19d7d20df54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963, portal: 172.16.0.220,3260]
Apr 11 19:44:56 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963, portal: 172.16.0.220,3260] successful.
Apr 11 19:44:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[693d6c36-1f24-437d-801f-eef5c6672258]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG nova.network.neutron [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updated VIF entry in instance network info cache for port c3ef7018-189c-423e-b92b-b2b4a98dafce. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG nova.network.neutron [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updating instance_info_cache with network_info: [{"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[17578edd-a061-4718-8a12-388251a5e357]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:44:56 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:44:56 user nova-compute[82196]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 (non-flash)
Apr 11 19:44:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:44:56 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:44:56 user nova-compute[82196]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 (non-flash)
Apr 11 19:44:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] Releasing lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-fb0635a1-168b-412c-b6ed-7709a7a9a8d4 req-9331bd17-1e61-4a6e-9fb4-2f836b0f4d64 service nova] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Received event network-vif-deleted-c662b1b3-b2b3-4502-81af-9afdf3e591dc {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquired lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG nova.network.neutron [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e147ef-c424-4f21-88f5-921ed515d2a2]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCmMyean', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG nova.network.neutron [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updating instance_info_cache with network_info: [{"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Releasing lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:44:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Starting migrate_disk_and_power_off {{(pid=82196) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received event network-vif-unplugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] No waiting events found dispatching network-vif-unplugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:44:57 user nova-compute[82196]: WARNING nova.compute.manager [req-b1cc13e2-5834-4346-9841-3579bdf566fe req-13515d71-6e39-4cf1-8ba8-e56e7f1f990e service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received unexpected event network-vif-unplugged-c3ef7018-189c-423e-b92b-b2b4a98dafce for instance with vm_state active and task_state resize_migrating.
Apr 11 19:44:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26433386666393063', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433386666393063', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG nova.objects.instance [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'flavor' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:44:57 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:44:57 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:44:57 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:44:57 user nova-compute[82196]:   <serial>873005bd-7295-415c-b38f-2b5d07bca963</serial>
Apr 11 19:44:57 user nova-compute[82196]: </disk>
Apr 11 19:44:57 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:57 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Instance destroyed successfully.
Apr 11 19:44:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2146974288',display_name='tempest-ServerActionsTestJSON-server-2146974288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2146974288',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-2nw0xxm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:44:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=f633037d-87d0-4dda-aa33-3cc9c3191080,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:38:36:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:38:36:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG os_vif [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3ef7018-18, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:44:57 user nova-compute[82196]: INFO os_vif [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18')
Apr 11 19:44:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipgYEafu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:44:57 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:44:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:44:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7639a5-e1c3-439c-ae44-c8e9b7c3a62a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:44:58 user nova-compute[82196]: No targets found.
Apr 11 19:44:58 user nova-compute[82196]: iSNS:
Apr 11 19:44:58 user nova-compute[82196]: No targets found.
Apr 11 19:44:58 user nova-compute[82196]: STATIC:
Apr 11 19:44:58 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963
Apr 11 19:44:58 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:58 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:58 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d
Apr 11 19:44:58 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:58 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:58 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037
Apr 11 19:44:58 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:44:58 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:44:58 user nova-compute[82196]: FIRMWARE:
Apr 11 19:44:58 user nova-compute[82196]: No targets found.
Apr 11 19:44:58 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:44:58 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:44:58 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[656ff6b8-e4f7-4b1e-8efd-99c5a18255d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No VIF found with MAC fa:16:3e:d3:a7:89, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bd5f56-137e-4a1b-aedb-a9b87db497d2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:44:58 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:44:58 user nova-compute[82196]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 (non-flash)
Apr 11 19:44:58 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:44:58 user nova-compute[82196]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:44:58 user nova-compute[82196]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 (non-flash)
Apr 11 19:44:58 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92404ccdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d'): ({'sdc'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Removing single pathed devices sdc {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99d6ac3-70a1-4f84-b01f-e025bc54c3f0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ae5ead-f872-42d5-81b3-ab3ab2d474f6]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flushing IO for device /dev/sdc {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa18408-19b1-4e1c-948f-3acab2dbee77]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9ffb18b3-2224-47ff-8555-4e2981f625a3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.722s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[946c3450-5b8d-44ab-8da3-b6f90fafa439]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41b65d6-2c9d-406d-b142-7da658800ea4]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8037b32f-7b15-4969-9481-ad118ca8360b]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260]
Apr 11 19:44:58 user nova-compute[82196]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260] successful.
Apr 11 19:44:58 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccd13e1-f65a-4f08-9673-9ca0686710cf]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== disconnect_volume: return (382ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received event network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] No waiting events found dispatching network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:44:59 user nova-compute[82196]: WARNING nova.compute.manager [req-100b8cf8-9a5f-483a-9d89-7c126bb0cd6e req-db1e67da-9928-4696-9192-2b102fa6c70c service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received unexpected event network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce for instance with vm_state active and task_state resize_migrating.
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG nova.network.neutron [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Port c3ef7018-189c-423e-b92b-b2b4a98dafce binding to destination host user is already ACTIVE {{(pid=82196) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:44:59 user nova-compute[82196]: INFO nova.compute.manager [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Detaching volume 873005bd-7295-415c-b38f-2b5d07bca963
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquired lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG nova.network.neutron [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:44:59 user nova-compute[82196]: INFO nova.virt.block_device [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attempting to driver detach volume 873005bd-7295-415c-b38f-2b5d07bca963 from mountpoint /dev/vdb
Apr 11 19:44:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Attempting to detach device vdb from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:44:59 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:44:59 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:44:59 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:44:59 user nova-compute[82196]:   <serial>873005bd-7295-415c-b38f-2b5d07bca963</serial>
Apr 11 19:44:59 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:44:59 user nova-compute[82196]: </disk>
Apr 11 19:44:59 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:44:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Successfully detached device vdb from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the persistent domain config.
Apr 11 19:44:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:44:59 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:44:59 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:44:59 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:44:59 user nova-compute[82196]:   <serial>873005bd-7295-415c-b38f-2b5d07bca963</serial>
Apr 11 19:44:59 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:44:59 user nova-compute[82196]: </disk>
Apr 11 19:44:59 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:44:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681242300.2751937, 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:45:00 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Successfully detached device vdb from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the live domain config.
Apr 11 19:45:00 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:45:00 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8098MB free_disk=26.145004272460938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCmMyean', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:45:00 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bea3899-02ac-4b89-ac0e-5deaa464ac3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:45:00 user nova-compute[82196]: No targets found.
Apr 11 19:45:00 user nova-compute[82196]: iSNS:
Apr 11 19:45:00 user nova-compute[82196]: No targets found.
Apr 11 19:45:00 user nova-compute[82196]: STATIC:
Apr 11 19:45:00 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963
Apr 11 19:45:00 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:45:00 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:45:00 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037
Apr 11 19:45:00 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:45:00 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:45:00 user nova-compute[82196]: FIRMWARE:
Apr 11 19:45:00 user nova-compute[82196]: No targets found.
Apr 11 19:45:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:45:00 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:45:00 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4786d0-3dba-42ad-b861-ee29d2e61ea6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[402b5781-dee6-4f10-8b20-669e03a1928b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:00 user nova-compute[82196]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 (non-flash)
Apr 11 19:45:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:00 user nova-compute[82196]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 (non-flash)
Apr 11 19:45:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92404995a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963'): ({'sdb'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Removing single pathed devices sdb {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Applying migration context for instance f633037d-87d0-4dda-aa33-3cc9c3191080 as it has an incoming, in-progress migration 3839b6ea-9b2e-4f67-9730-ef911fd3ecfb. Migration status is post-migrating {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 19:45:00 user nova-compute[82196]: INFO nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updating resource usage from migration 3839b6ea-9b2e-4f67-9730-ef911fd3ecfb
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[262654dc-9445-45b0-8c26-cc67490804b7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance a66c1d51-e194-424d-a37c-d308544774c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Migration 3839b6ea-9b2e-4f67-9730-ef911fd3ecfb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance f633037d-87d0-4dda-aa33-3cc9c3191080 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb91bed7-56b8-48a8-a6e4-2058d7811fed]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Flushing IO for device /dev/sdb {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[591449f1-8c18-40a4-97ab-ee6c498fa72a]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.network.neutron [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updating instance_info_cache with network_info: [{"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Releasing lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba0c34d-0b59-4dc4-b751-4c084be9025c]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4317c376-a4b2-4158-858e-52f3c43b8174]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.utils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[731b47d6-c388-4602-ac89-585140c015b8]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b7e92b-be16-4316-a20b-729f57eedcf2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963, portal: 172.16.0.220,3260]
Apr 11 19:45:00 user nova-compute[82196]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963, portal: 172.16.0.220,3260] successful.
Apr 11 19:45:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873005bd-7295-415c-b38f-2b5d07bca963 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff841df8-bf57-4304-aeb8-89850d7cf6ea]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e8aef7-c46a-479a-919a-e69509ddb14b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] <== disconnect_volume: return (317ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9ef562-4731-4148-88e2-f25d66e4a004]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d377ac39-1ac3-4491-8e72-a01f274f9353]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:45:00 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b92db0-c5cb-4a71-8647-e175c91bdb23]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG os_brick.utils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:45:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:01 user nova-compute[82196]: DEBUG nova.objects.instance [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'flavor' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:45:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e4905172-fc11-4a1d-88a8-1b529262815d tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.129s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:45:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:45:03 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:04 user nova-compute[82196]: INFO nova.compute.manager [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Terminating instance
Apr 11 19:45:04 user nova-compute[82196]: DEBUG nova.compute.manager [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-12178263-f359-4f8d-b4e8-0f42cf04e67d req-773037e0-f067-449f-afb2-dc8204a40ef5 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Received event network-vif-unplugged-8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-12178263-f359-4f8d-b4e8-0f42cf04e67d req-773037e0-f067-449f-afb2-dc8204a40ef5 service nova] Acquiring lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-12178263-f359-4f8d-b4e8-0f42cf04e67d req-773037e0-f067-449f-afb2-dc8204a40ef5 service nova] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-12178263-f359-4f8d-b4e8-0f42cf04e67d req-773037e0-f067-449f-afb2-dc8204a40ef5 service nova] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-12178263-f359-4f8d-b4e8-0f42cf04e67d req-773037e0-f067-449f-afb2-dc8204a40ef5 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] No waiting events found dispatching network-vif-unplugged-8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:45:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-12178263-f359-4f8d-b4e8-0f42cf04e67d req-773037e0-f067-449f-afb2-dc8204a40ef5 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Received event network-vif-unplugged-8c77eb6a-6186-4c87-9e30-48420d525f90 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:45:05 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Instance destroyed successfully.
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.objects.instance [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lazy-loading 'resources' on Instance uuid 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:25:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-309051286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-309051286',id=18,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:25:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb91586feb3f4a4c84fa8c2183baaf8c',ramdisk_id='',reservation_id='r-0tio27u6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-863156619',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:27:25Z,user_data=None,user_id='1b3adca432b04d70818a51d1366f5c6d',uuid=9e2d23e8-2d2e-4b3e-94d8-01b17242dac5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converting VIF {"id": "8c77eb6a-6186-4c87-9e30-48420d525f90", "address": "fa:16:3e:91:4e:8b", "network": {"id": "eeacad54-05f6-4aba-aed7-13baddfb50e2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-481014793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb91586feb3f4a4c84fa8c2183baaf8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c77eb6a-61", "ovs_interfaceid": "8c77eb6a-6186-4c87-9e30-48420d525f90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:4e:8b,bridge_name='br-int',has_traffic_filtering=True,id=8c77eb6a-6186-4c87-9e30-48420d525f90,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c77eb6a-61') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_vif [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:4e:8b,bridge_name='br-int',has_traffic_filtering=True,id=8c77eb6a-6186-4c87-9e30-48420d525f90,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c77eb6a-61') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c77eb6a-61, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:05 user nova-compute[82196]: INFO os_vif [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:4e:8b,bridge_name='br-int',has_traffic_filtering=True,id=8c77eb6a-6186-4c87-9e30-48420d525f90,network=Network(eeacad54-05f6-4aba-aed7-13baddfb50e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c77eb6a-61')
Apr 11 19:45:05 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Deleting instance files /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5_del
Apr 11 19:45:05 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Deletion of /opt/stack/data/nova/instances/9e2d23e8-2d2e-4b3e-94d8-01b17242dac5_del complete
Apr 11 19:45:05 user nova-compute[82196]: INFO nova.compute.manager [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Starting finish_migration {{(pid=82196) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Instance directory exists: not creating {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 19:45:05 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Creating image(s)
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Ensure instance console log exists: /opt/stack/data/nova/instances/f633037d-87d0-4dda-aa33-3cc9c3191080/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Start _get_guest_xml network_info=[{"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:38:36:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipgYEafu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f633037d-87d0-4dda-aa33-3cc9c3191080', 'attached_at': '2023-04-11T19:45:05.000000', 'detached_at': '', 'volume_id': '8cc8ee09-43bc-4887-ad61-c9f10b5f487d', 'serial': '8cc8ee09-43bc-4887-ad61-c9f10b5f487d'}, 'attachment_id': '350250e0-3234-4bdf-8cea-da4be39b029b', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:45:05 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:45:05 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:19:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.objects.instance [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'vcpu_model' on Instance uuid f633037d-87d0-4dda-aa33-3cc9c3191080 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipgYEafu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:45:05 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:45:05 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:45:05 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8aa535-3707-4e3c-a799-181993ae1a5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:45:05 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edc3907-2594-4cd5-a0c7-094ad870d8e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d] added
Apr 11 19:45:05 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a023e91c-ff38-4d2f-8abb-52729ab324ed]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[14444ad9-4e55-47ca-ae22-60c832d2a0ae]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipgYEafu {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipgYEafu" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a38a3-81b8-4ab9-80a6-ff14f6e12f4f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ipgYEafu'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0efb3ca-c05c-4e5b-9aed-e655fcfd7381]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e640768f-1a15-4f40-b4d8-67bb83baa26b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:05 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:05 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea6fcd5-9f23-45ec-b297-2ae58017420e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260]
Apr 11 19:45:05 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260] successful.
Apr 11 19:45:05 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[747893eb-2fd0-4e64-bd81-5b8cba882bb4]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be058ce-80d3-471f-a727-a8c3f76326f7]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:05 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:45:05 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:05 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:45:05 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:05 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Took 0.51 seconds to deallocate network for instance.
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7be0a3-c93a-40f6-b17c-f4c879e4e5e3]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipgYEafu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-3c480ccb-adc9-4b9f-8ff7-7b0e84a29699 req-7423b352-fb95-4c97-8df5-fff6ca72dfe2 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Received event network-vif-deleted-8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:06 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Deleted allocations for instance 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5
Apr 11 19:45:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-c9f03171-85a5-44c7-aca3-a66759a22c8d tempest-ServerBootFromVolumeStableRescueTest-863156619 tempest-ServerBootFromVolumeStableRescueTest-863156619-project-member] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.885s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Received event network-changed-397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Refreshing instance network info cache due to event network-changed-397ebb82-45b3-41ad-bbac-ef07140bf942. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] Acquiring lock "refresh_cache-a66c1d51-e194-424d-a37c-d308544774c6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] Acquired lock "refresh_cache-a66c1d51-e194-424d-a37c-d308544774c6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.network.neutron [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Refreshing network info cache for port 397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26566366539353030', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566366539353030', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2146974288',display_name='tempest-ServerActionsTestJSON-server-2146974288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2146974288',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-2nw0xxm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:44:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=f633037d-87d0-4dda-aa33-3cc9c3191080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:38:36:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:38:36:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:45:06 user nova-compute[82196]:   <uuid>f633037d-87d0-4dda-aa33-3cc9c3191080</uuid>
Apr 11 19:45:06 user nova-compute[82196]:   <name>instance-0000002a</name>
Apr 11 19:45:06 user nova-compute[82196]:   <memory>196608</memory>
Apr 11 19:45:06 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:45:06 user nova-compute[82196]:   <metadata>
Apr 11 19:45:06 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:45:06 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:45:06 user nova-compute[82196]:       <nova:name>tempest-ServerActionsTestJSON-server-2146974288</nova:name>
Apr 11 19:45:06 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:45:05</nova:creationTime>
Apr 11 19:45:06 user nova-compute[82196]:       <nova:flavor name="m1.micro">
Apr 11 19:45:06 user nova-compute[82196]:         <nova:memory>192</nova:memory>
Apr 11 19:45:06 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:45:06 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:45:06 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:45:06 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:45:06 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:45:06 user nova-compute[82196]:       <nova:owner>
Apr 11 19:45:06 user nova-compute[82196]:         <nova:user uuid="05fb551c320a48f98a4ec00a7f7492d7">tempest-ServerActionsTestJSON-37730514-project-member</nova:user>
Apr 11 19:45:06 user nova-compute[82196]:         <nova:project uuid="60a7381a31b84e97a068528f90813773">tempest-ServerActionsTestJSON-37730514</nova:project>
Apr 11 19:45:06 user nova-compute[82196]:       </nova:owner>
Apr 11 19:45:06 user nova-compute[82196]:       <nova:ports>
Apr 11 19:45:06 user nova-compute[82196]:         <nova:port uuid="c3ef7018-189c-423e-b92b-b2b4a98dafce">
Apr 11 19:45:06 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 19:45:06 user nova-compute[82196]:         </nova:port>
Apr 11 19:45:06 user nova-compute[82196]:       </nova:ports>
Apr 11 19:45:06 user nova-compute[82196]:     </nova:instance>
Apr 11 19:45:06 user nova-compute[82196]:   </metadata>
Apr 11 19:45:06 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:45:06 user nova-compute[82196]:     <system>
Apr 11 19:45:06 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:45:06 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:45:06 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:45:06 user nova-compute[82196]:       <entry name="serial">f633037d-87d0-4dda-aa33-3cc9c3191080</entry>
Apr 11 19:45:06 user nova-compute[82196]:       <entry name="uuid">f633037d-87d0-4dda-aa33-3cc9c3191080</entry>
Apr 11 19:45:06 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:45:06 user nova-compute[82196]:     </system>
Apr 11 19:45:06 user nova-compute[82196]:   </sysinfo>
Apr 11 19:45:06 user nova-compute[82196]:   <os>
Apr 11 19:45:06 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:45:06 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:45:06 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:45:06 user nova-compute[82196]:   </os>
Apr 11 19:45:06 user nova-compute[82196]:   <features>
Apr 11 19:45:06 user nova-compute[82196]:     <acpi/>
Apr 11 19:45:06 user nova-compute[82196]:     <apic/>
Apr 11 19:45:06 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:45:06 user nova-compute[82196]:   </features>
Apr 11 19:45:06 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:45:06 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:45:06 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:45:06 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:45:06 user nova-compute[82196]:   </clock>
Apr 11 19:45:06 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:45:06 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:45:06 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:45:06 user nova-compute[82196]:   </cpu>
Apr 11 19:45:06 user nova-compute[82196]:   <devices>
Apr 11 19:45:06 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:45:06 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:45:06 user nova-compute[82196]:       <source dev="/dev/sdb"/>
Apr 11 19:45:06 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:45:06 user nova-compute[82196]:       <serial>8cc8ee09-43bc-4887-ad61-c9f10b5f487d</serial>
Apr 11 19:45:06 user nova-compute[82196]:     </disk>
Apr 11 19:45:06 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:45:06 user nova-compute[82196]:       <mac address="fa:16:3e:38:36:1c"/>
Apr 11 19:45:06 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:45:06 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:45:06 user nova-compute[82196]:       <target dev="tapc3ef7018-18"/>
Apr 11 19:45:06 user nova-compute[82196]:     </interface>
Apr 11 19:45:06 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:45:06 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/f633037d-87d0-4dda-aa33-3cc9c3191080/console.log" append="off"/>
Apr 11 19:45:06 user nova-compute[82196]:     </serial>
Apr 11 19:45:06 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:45:06 user nova-compute[82196]:     <video>
Apr 11 19:45:06 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:45:06 user nova-compute[82196]:     </video>
Apr 11 19:45:06 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:45:06 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:45:06 user nova-compute[82196]:     </rng>
Apr 11 19:45:06 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:45:06 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:45:06 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:45:06 user nova-compute[82196]:     </memballoon>
Apr 11 19:45:06 user nova-compute[82196]:   </devices>
Apr 11 19:45:06 user nova-compute[82196]: </domain>
Apr 11 19:45:06 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2146974288',display_name='tempest-ServerActionsTestJSON-server-2146974288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2146974288',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-2nw0xxm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:44:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=f633037d-87d0-4dda-aa33-3cc9c3191080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:38:36:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1769183343-network", "vif_mac": "fa:16:3e:38:36:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG os_vif [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3ef7018-18, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3ef7018-18, col_values=(('external_ids', {'iface-id': 'c3ef7018-189c-423e-b92b-b2b4a98dafce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:36:1c', 'vm-uuid': 'f633037d-87d0-4dda-aa33-3cc9c3191080'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:06 user nova-compute[82196]: INFO os_vif [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18')
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:45:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] No VIF found with MAC fa:16:3e:38:36:1c, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:45:07 user nova-compute[82196]: DEBUG nova.network.neutron [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Updated VIF entry in instance network info cache for port 397ebb82-45b3-41ad-bbac-ef07140bf942. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:45:07 user nova-compute[82196]: DEBUG nova.network.neutron [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Updating instance_info_cache with network_info: [{"id": "397ebb82-45b3-41ad-bbac-ef07140bf942", "address": "fa:16:3e:33:3a:fc", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ebb82-45", "ovs_interfaceid": "397ebb82-45b3-41ad-bbac-ef07140bf942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:45:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] Releasing lock "refresh_cache-a66c1d51-e194-424d-a37c-d308544774c6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:45:07 user nova-compute[82196]: DEBUG nova.compute.manager [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Received event network-vif-plugged-8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:45:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] Acquiring lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] Lock "9e2d23e8-2d2e-4b3e-94d8-01b17242dac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:07 user nova-compute[82196]: DEBUG nova.compute.manager [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] No waiting events found dispatching network-vif-plugged-8c77eb6a-6186-4c87-9e30-48420d525f90 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:45:07 user nova-compute[82196]: WARNING nova.compute.manager [req-4a30b08b-acd8-4c25-9992-9fe0ca6f4a5c req-f9d5d470-f103-490b-b176-5ecf101e4c53 service nova] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Received unexpected event network-vif-plugged-8c77eb6a-6186-4c87-9e30-48420d525f90 for instance with vm_state deleted and task_state None.
Apr 11 19:45:07 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242292.8377705, bf0a75f5-2f44-4687-af12-046f6761fee2 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:45:07 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] VM Stopped (Lifecycle Event)
Apr 11 19:45:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-adc9ac65-ff00-4ca2-9c15-be3d0d79fc06 None None] [instance: bf0a75f5-2f44-4687-af12-046f6761fee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:45:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:08 user nova-compute[82196]: DEBUG nova.compute.manager [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received event network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:45:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:08 user nova-compute[82196]: DEBUG nova.compute.manager [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] No waiting events found dispatching network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:45:08 user nova-compute[82196]: WARNING nova.compute.manager [req-a6646f20-3a01-4d45-b46e-5f5dfbaf57ea req-d0458e34-120a-45e1-8065-f4f6e1ddc6f4 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received unexpected event network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce for instance with vm_state active and task_state resize_finish.
Apr 11 19:45:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "589934d3-f72e-49d4-a230-1748ba0d5ee2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:45:09 user nova-compute[82196]: INFO nova.compute.claims [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Claim successful on node user
Apr 11 19:45:09 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:45:09 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:45:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG nova.policy [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf262cd03f4a41c4956d8784cf37d86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caba0618fc743e7bfb2dd866a511df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:45:09 user nova-compute[82196]: INFO nova.virt.block_device [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Booting with volume d92e8c90-19c1-484b-8294-655686396811 at /dev/vda
Apr 11 19:45:09 user nova-compute[82196]: DEBUG os_brick.utils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[92803680-f08b-436f-8415-58e106ec19eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da5346c-47ca-40d6-9c31-e87a2079e948]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec8726f-0d41-4474-b450-c838b31e9579]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b23abce-ecbf-4503-ba9d-3e153d97025a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:45:09 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:45:09 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bf10d8-f458-4773-8293-479f030b8fa7]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG os_brick.utils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:45:09 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Updating existing volume attachment record: 4264fd0c-f99c-45ba-9a5c-24f9d305d53e {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:45:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for f633037d-87d0-4dda-aa33-3cc9c3191080 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:45:10 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242310.2493017, f633037d-87d0-4dda-aa33-3cc9c3191080 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:45:10 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] VM Resumed (Lifecycle Event)
Apr 11 19:45:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:45:10 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Instance running successfully.
Apr 11 19:45:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Failed to set time: agent not configured {{(pid=82196) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 19:45:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-9dbc72c5-f5ae-4ab2-ba00-c7e4463ab8db tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] finish_migration finished successfully. {{(pid=82196) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 19:45:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:45:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:45:10 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 19:45:10 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242310.2498238, f633037d-87d0-4dda-aa33-3cc9c3191080 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:45:10 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] VM Started (Lifecycle Event)
Apr 11 19:45:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:45:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:45:10 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 19:45:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Successfully created port: 42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:45:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received event network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:45:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:11 user nova-compute[82196]: DEBUG nova.compute.manager [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] No waiting events found dispatching network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:45:11 user nova-compute[82196]: WARNING nova.compute.manager [req-952dfcfa-4d53-4ac4-8913-4cae2512d239 req-c80217bf-23ad-4bb6-a1f4-ba5b41100e23 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received unexpected event network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce for instance with vm_state resized and task_state None.
Apr 11 19:45:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Successfully updated port: 42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:45:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "refresh_cache-589934d3-f72e-49d4-a230-1748ba0d5ee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:45:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquired lock "refresh_cache-589934d3-f72e-49d4-a230-1748ba0d5ee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:45:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:45:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:45:12 user nova-compute[82196]: DEBUG nova.network.neutron [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Updating instance_info_cache with network_info: [{"id": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "address": "fa:16:3e:e5:51:45", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d318d4-06", "ovs_interfaceid": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:45:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Releasing lock "refresh_cache-589934d3-f72e-49d4-a230-1748ba0d5ee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:45:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Instance network_info: |[{"id": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "address": "fa:16:3e:e5:51:45", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d318d4-06", "ovs_interfaceid": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:45:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Received event network-changed-42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:45:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Refreshing instance network info cache due to event network-changed-42d318d4-06e2-42de-93b2-504f5a5a51e5. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:45:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] Acquiring lock "refresh_cache-589934d3-f72e-49d4-a230-1748ba0d5ee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:45:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] Acquired lock "refresh_cache-589934d3-f72e-49d4-a230-1748ba0d5ee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:45:12 user nova-compute[82196]: DEBUG nova.network.neutron [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Refreshing network info cache for port 42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:45:13 user nova-compute[82196]: DEBUG nova.network.neutron [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Updated VIF entry in instance network info cache for port 42d318d4-06e2-42de-93b2-504f5a5a51e5. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:45:13 user nova-compute[82196]: DEBUG nova.network.neutron [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Updating instance_info_cache with network_info: [{"id": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "address": "fa:16:3e:e5:51:45", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d318d4-06", "ovs_interfaceid": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:45:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1c016588-666d-4f29-bf02-7b6410540ad2 req-bad5afab-84ec-4b40-ad15-b14ab205f9f0 service nova] Releasing lock "refresh_cache-589934d3-f72e-49d4-a230-1748ba0d5ee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:45:14 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Creating image(s)
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Did not create local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Ensure instance console log exists: /opt/stack/data/nova/instances/589934d3-f72e-49d4-a230-1748ba0d5ee2/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Start _get_guest_xml network_info=[{"id": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "address": "fa:16:3e:e5:51:45", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d318d4-06", "ovs_interfaceid": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPyOLbUw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '589934d3-f72e-49d4-a230-1748ba0d5ee2', 'attached_at': '', 'detached_at': '', 'volume_id': 'd92e8c90-19c1-484b-8294-655686396811', 'serial': 'd92e8c90-19c1-484b-8294-655686396811'}, 'attachment_id': '4264fd0c-f99c-45ba-9a5c-24f9d305d53e', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:45:14 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:45:14 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPyOLbUw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:45:14 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:45:14 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:45:14 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5672594-13f0-4cb0-a753-922435a23a63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:45:14 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a92b4eb-b878-42b0-9e7f-4fa1cd393ef4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811] added
Apr 11 19:45:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45d766e-574a-4029-8c01-ccbe05c82669]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6fd026-09a3-4362-9aa7-68db6bc84ab8]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPyOLbUw {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPyOLbUw" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[770f58ea-b478-4e13-91cb-813b3d1d50da]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BPyOLbUw'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[30322211-c512-47ec-bea0-9a6e3ec1b887]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[190fe8f6-bab1-429c-b5a3-55d4a817c180]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:14 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:45:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:14 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:45:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8907c75d-7394-458a-8e07-7f1c627d6e3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811, portal: 172.16.0.220,3260]
Apr 11 19:45:14 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811, portal: 172.16.0.220,3260] successful.
Apr 11 19:45:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcde25f-240d-4b7d-8f53-f6a124c167b4]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[69646cc6-65b5-4e86-801a-a4d9441a7850]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:14 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:45:14 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:45:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:14 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:45:14 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:45:14 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[426175ab-3760-4e9a-873f-304e9a3dcf46]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:14 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPyOLbUw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23833656535396433', 'path': '/dev/sdc'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833656535396433', 'path': '/dev/sdc'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-225631843',display_name='tempest-TestVolumeBootPattern-server-225631843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-225631843',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPal5dIOOTQX1AtimGkw05FO0Z9eaerqpiFYTxmlD5RcLLewnhLN4pAKWK7d0rX0zQgFYrr+JvrnM8AxIhiJUbrvnXCoFiGl5kaOegYnss1VivHpq7rMu1EVV1XJIRedHg==',key_name='tempest-TestVolumeBootPattern-1844027973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-zvljxzxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:45:10Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=589934d3-f72e-49d4-a230-1748ba0d5ee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "address": "fa:16:3e:e5:51:45", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d318d4-06", "ovs_interfaceid": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "address": "fa:16:3e:e5:51:45", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d318d4-06", "ovs_interfaceid": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:51:45,bridge_name='br-int',has_traffic_filtering=True,id=42d318d4-06e2-42de-93b2-504f5a5a51e5,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d318d4-06') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG nova.objects.instance [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lazy-loading 'pci_devices' on Instance uuid 589934d3-f72e-49d4-a230-1748ba0d5ee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:45:15 user nova-compute[82196]:   <uuid>589934d3-f72e-49d4-a230-1748ba0d5ee2</uuid>
Apr 11 19:45:15 user nova-compute[82196]:   <name>instance-0000002c</name>
Apr 11 19:45:15 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:45:15 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:45:15 user nova-compute[82196]:   <metadata>
Apr 11 19:45:15 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:45:15 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:45:15 user nova-compute[82196]:       <nova:name>tempest-TestVolumeBootPattern-server-225631843</nova:name>
Apr 11 19:45:15 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:45:14</nova:creationTime>
Apr 11 19:45:15 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:45:15 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:45:15 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:45:15 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:45:15 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:45:15 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:45:15 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:45:15 user nova-compute[82196]:       <nova:owner>
Apr 11 19:45:15 user nova-compute[82196]:         <nova:user uuid="cf262cd03f4a41c4956d8784cf37d86d">tempest-TestVolumeBootPattern-935343500-project-member</nova:user>
Apr 11 19:45:15 user nova-compute[82196]:         <nova:project uuid="2caba0618fc743e7bfb2dd866a511df9">tempest-TestVolumeBootPattern-935343500</nova:project>
Apr 11 19:45:15 user nova-compute[82196]:       </nova:owner>
Apr 11 19:45:15 user nova-compute[82196]:       <nova:ports>
Apr 11 19:45:15 user nova-compute[82196]:         <nova:port uuid="42d318d4-06e2-42de-93b2-504f5a5a51e5">
Apr 11 19:45:15 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 19:45:15 user nova-compute[82196]:         </nova:port>
Apr 11 19:45:15 user nova-compute[82196]:       </nova:ports>
Apr 11 19:45:15 user nova-compute[82196]:     </nova:instance>
Apr 11 19:45:15 user nova-compute[82196]:   </metadata>
Apr 11 19:45:15 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:45:15 user nova-compute[82196]:     <system>
Apr 11 19:45:15 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:45:15 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:45:15 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:45:15 user nova-compute[82196]:       <entry name="serial">589934d3-f72e-49d4-a230-1748ba0d5ee2</entry>
Apr 11 19:45:15 user nova-compute[82196]:       <entry name="uuid">589934d3-f72e-49d4-a230-1748ba0d5ee2</entry>
Apr 11 19:45:15 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:45:15 user nova-compute[82196]:     </system>
Apr 11 19:45:15 user nova-compute[82196]:   </sysinfo>
Apr 11 19:45:15 user nova-compute[82196]:   <os>
Apr 11 19:45:15 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:45:15 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:45:15 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:45:15 user nova-compute[82196]:   </os>
Apr 11 19:45:15 user nova-compute[82196]:   <features>
Apr 11 19:45:15 user nova-compute[82196]:     <acpi/>
Apr 11 19:45:15 user nova-compute[82196]:     <apic/>
Apr 11 19:45:15 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:45:15 user nova-compute[82196]:   </features>
Apr 11 19:45:15 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:45:15 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:45:15 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:45:15 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:45:15 user nova-compute[82196]:   </clock>
Apr 11 19:45:15 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:45:15 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:45:15 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:45:15 user nova-compute[82196]:   </cpu>
Apr 11 19:45:15 user nova-compute[82196]:   <devices>
Apr 11 19:45:15 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:45:15 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:45:15 user nova-compute[82196]:       <source dev="/dev/sdc"/>
Apr 11 19:45:15 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:45:15 user nova-compute[82196]:       <serial>d92e8c90-19c1-484b-8294-655686396811</serial>
Apr 11 19:45:15 user nova-compute[82196]:     </disk>
Apr 11 19:45:15 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:45:15 user nova-compute[82196]:       <mac address="fa:16:3e:e5:51:45"/>
Apr 11 19:45:15 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:45:15 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:45:15 user nova-compute[82196]:       <target dev="tap42d318d4-06"/>
Apr 11 19:45:15 user nova-compute[82196]:     </interface>
Apr 11 19:45:15 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:45:15 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/589934d3-f72e-49d4-a230-1748ba0d5ee2/console.log" append="off"/>
Apr 11 19:45:15 user nova-compute[82196]:     </serial>
Apr 11 19:45:15 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:45:15 user nova-compute[82196]:     <video>
Apr 11 19:45:15 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:45:15 user nova-compute[82196]:     </video>
Apr 11 19:45:15 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:45:15 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:45:15 user nova-compute[82196]:     </rng>
Apr 11 19:45:15 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:45:15 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:45:15 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:45:15 user nova-compute[82196]:     </memballoon>
Apr 11 19:45:15 user nova-compute[82196]:   </devices>
Apr 11 19:45:15 user nova-compute[82196]: </domain>
Apr 11 19:45:15 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-225631843',display_name='tempest-TestVolumeBootPattern-server-225631843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-225631843',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPal5dIOOTQX1AtimGkw05FO0Z9eaerqpiFYTxmlD5RcLLewnhLN4pAKWK7d0rX0zQgFYrr+JvrnM8AxIhiJUbrvnXCoFiGl5kaOegYnss1VivHpq7rMu1EVV1XJIRedHg==',key_name='tempest-TestVolumeBootPattern-1844027973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-zvljxzxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:45:10Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=589934d3-f72e-49d4-a230-1748ba0d5ee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "address": "fa:16:3e:e5:51:45", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d318d4-06", "ovs_interfaceid": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "address": "fa:16:3e:e5:51:45", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d318d4-06", "ovs_interfaceid": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:51:45,bridge_name='br-int',has_traffic_filtering=True,id=42d318d4-06e2-42de-93b2-504f5a5a51e5,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d318d4-06') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG os_vif [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:51:45,bridge_name='br-int',has_traffic_filtering=True,id=42d318d4-06e2-42de-93b2-504f5a5a51e5,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d318d4-06') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42d318d4-06, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap42d318d4-06, col_values=(('external_ids', {'iface-id': '42d318d4-06e2-42de-93b2-504f5a5a51e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:51:45', 'vm-uuid': '589934d3-f72e-49d4-a230-1748ba0d5ee2'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:15 user nova-compute[82196]: INFO os_vif [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:51:45,bridge_name='br-int',has_traffic_filtering=True,id=42d318d4-06e2-42de-93b2-504f5a5a51e5,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d318d4-06')
Apr 11 19:45:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:45:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] No VIF found with MAC fa:16:3e:e5:51:45, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:45:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-1ebb5d06-8a13-4e8d-b0c9-fa6f47ca43b4 req-30cb291c-006c-4fbd-a544-d7d60e44e748 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Received event network-vif-plugged-42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:45:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1ebb5d06-8a13-4e8d-b0c9-fa6f47ca43b4 req-30cb291c-006c-4fbd-a544-d7d60e44e748 service nova] Acquiring lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1ebb5d06-8a13-4e8d-b0c9-fa6f47ca43b4 req-30cb291c-006c-4fbd-a544-d7d60e44e748 service nova] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-1ebb5d06-8a13-4e8d-b0c9-fa6f47ca43b4 req-30cb291c-006c-4fbd-a544-d7d60e44e748 service nova] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-1ebb5d06-8a13-4e8d-b0c9-fa6f47ca43b4 req-30cb291c-006c-4fbd-a544-d7d60e44e748 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] No waiting events found dispatching network-vif-plugged-42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:45:17 user nova-compute[82196]: WARNING nova.compute.manager [req-1ebb5d06-8a13-4e8d-b0c9-fa6f47ca43b4 req-30cb291c-006c-4fbd-a544-d7d60e44e748 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Received unexpected event network-vif-plugged-42d318d4-06e2-42de-93b2-504f5a5a51e5 for instance with vm_state building and task_state spawning.
Apr 11 19:45:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242319.1513896, 589934d3-f72e-49d4-a230-1748ba0d5ee2 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:45:19 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] VM Resumed (Lifecycle Event)
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:45:19 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Instance spawned successfully.
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:45:19 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242319.1526995, 589934d3-f72e-49d4-a230-1748ba0d5ee2 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:45:19 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] VM Started (Lifecycle Event)
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:45:19 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:45:19 user nova-compute[82196]: INFO nova.compute.manager [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Took 4.97 seconds to spawn the instance on the hypervisor.
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.compute.manager [req-e0d0834e-8b92-4964-b6c2-ed950ffd2c38 req-45d33778-d58c-42ff-94df-5dacef315d4b service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Received event network-vif-plugged-42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e0d0834e-8b92-4964-b6c2-ed950ffd2c38 req-45d33778-d58c-42ff-94df-5dacef315d4b service nova] Acquiring lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e0d0834e-8b92-4964-b6c2-ed950ffd2c38 req-45d33778-d58c-42ff-94df-5dacef315d4b service nova] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e0d0834e-8b92-4964-b6c2-ed950ffd2c38 req-45d33778-d58c-42ff-94df-5dacef315d4b service nova] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:19 user nova-compute[82196]: DEBUG nova.compute.manager [req-e0d0834e-8b92-4964-b6c2-ed950ffd2c38 req-45d33778-d58c-42ff-94df-5dacef315d4b service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] No waiting events found dispatching network-vif-plugged-42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:45:19 user nova-compute[82196]: WARNING nova.compute.manager [req-e0d0834e-8b92-4964-b6c2-ed950ffd2c38 req-45d33778-d58c-42ff-94df-5dacef315d4b service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Received unexpected event network-vif-plugged-42d318d4-06e2-42de-93b2-504f5a5a51e5 for instance with vm_state building and task_state spawning.
Apr 11 19:45:19 user nova-compute[82196]: INFO nova.compute.manager [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Took 10.41 seconds to build instance.
Apr 11 19:45:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-54aa67c9-d7b1-46a7-b638-5872a48cfeb8 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.512s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:20 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242305.0521097, 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:45:20 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] VM Stopped (Lifecycle Event)
Apr 11 19:45:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f850fd60-72aa-48ea-94be-f8a505695511 None None] [instance: 9e2d23e8-2d2e-4b3e-94d8-01b17242dac5] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:45:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:45 user nova-compute[82196]: INFO nova.compute.manager [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Terminating instance
Apr 11 19:45:45 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:45:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-69f32f62-9cd1-4ea6-963d-72824a7e4b19 req-ad61a6a9-e7b6-4389-8ec0-a4a81629d7b2 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-unplugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-69f32f62-9cd1-4ea6-963d-72824a7e4b19 req-ad61a6a9-e7b6-4389-8ec0-a4a81629d7b2 service nova] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-69f32f62-9cd1-4ea6-963d-72824a7e4b19 req-ad61a6a9-e7b6-4389-8ec0-a4a81629d7b2 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-69f32f62-9cd1-4ea6-963d-72824a7e4b19 req-ad61a6a9-e7b6-4389-8ec0-a4a81629d7b2 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-69f32f62-9cd1-4ea6-963d-72824a7e4b19 req-ad61a6a9-e7b6-4389-8ec0-a4a81629d7b2 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] No waiting events found dispatching network-vif-unplugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-69f32f62-9cd1-4ea6-963d-72824a7e4b19 req-ad61a6a9-e7b6-4389-8ec0-a4a81629d7b2 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-unplugged-1c929bc1-2708-4e38-80b3-354812ccb529 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:46 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Instance destroyed successfully.
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'resources' on Instance uuid 6f2616ce-4924-4b82-996a-2596ae8856a4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1478797351',display_name='tempest-ServerRescueNegativeTestJSON-server-1478797351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1478797351',id=26,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:31:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8e3a291c54b49db8e12a88ba41865e3',ramdisk_id='',reservation_id='r-wmbysh2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1429831687',owner_user_name='tempest-ServerRescueNegativeTestJSON-1429831687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:31:47Z,user_data=None,user_id='ba7f82b529e74d99838b6264b94d823b',uuid=6f2616ce-4924-4b82-996a-2596ae8856a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converting VIF {"id": "1c929bc1-2708-4e38-80b3-354812ccb529", "address": "fa:16:3e:d5:ad:54", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c929bc1-27", "ovs_interfaceid": "1c929bc1-2708-4e38-80b3-354812ccb529", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:ad:54,bridge_name='br-int',has_traffic_filtering=True,id=1c929bc1-2708-4e38-80b3-354812ccb529,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c929bc1-27') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG os_vif [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:ad:54,bridge_name='br-int',has_traffic_filtering=True,id=1c929bc1-2708-4e38-80b3-354812ccb529,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c929bc1-27') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c929bc1-27, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:45:46 user nova-compute[82196]: INFO os_vif [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:ad:54,bridge_name='br-int',has_traffic_filtering=True,id=1c929bc1-2708-4e38-80b3-354812ccb529,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c929bc1-27')
Apr 11 19:45:46 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Deleting instance files /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4_del
Apr 11 19:45:46 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Deletion of /opt/stack/data/nova/instances/6f2616ce-4924-4b82-996a-2596ae8856a4_del complete
Apr 11 19:45:46 user nova-compute[82196]: INFO nova.compute.manager [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 11 19:45:46 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:45:46 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Took 0.44 seconds to deallocate network for instance.
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-dbe162e3-a6c2-4c43-b09f-a79e892fa88d req-225205fd-af66-47f6-8e6e-5f98ab1f5f29 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-deleted-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:45:46 user nova-compute[82196]: INFO nova.compute.manager [req-dbe162e3-a6c2-4c43-b09f-a79e892fa88d req-225205fd-af66-47f6-8e6e-5f98ab1f5f29 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Neutron deleted interface 1c929bc1-2708-4e38-80b3-354812ccb529; detaching it from the instance and deleting it from the info cache
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.network.neutron [req-dbe162e3-a6c2-4c43-b09f-a79e892fa88d req-225205fd-af66-47f6-8e6e-5f98ab1f5f29 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-dbe162e3-a6c2-4c43-b09f-a79e892fa88d req-225205fd-af66-47f6-8e6e-5f98ab1f5f29 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Detach interface failed, port_id=1c929bc1-2708-4e38-80b3-354812ccb529, reason: Instance 6f2616ce-4924-4b82-996a-2596ae8856a4 could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:47 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:45:47 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:45:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:47 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Deleted allocations for instance 6f2616ce-4924-4b82-996a-2596ae8856a4
Apr 11 19:45:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6d7fb239-65d0-40e7-9099-409a706d065c tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.597s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-ef9636a4-a3d0-4a8e-9e36-6f25c57b6e8b req-c3150457-495f-4813-ae16-6fb897930cb5 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:45:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ef9636a4-a3d0-4a8e-9e36-6f25c57b6e8b req-c3150457-495f-4813-ae16-6fb897930cb5 service nova] Acquiring lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ef9636a4-a3d0-4a8e-9e36-6f25c57b6e8b req-c3150457-495f-4813-ae16-6fb897930cb5 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-ef9636a4-a3d0-4a8e-9e36-6f25c57b6e8b req-c3150457-495f-4813-ae16-6fb897930cb5 service nova] Lock "6f2616ce-4924-4b82-996a-2596ae8856a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:48 user nova-compute[82196]: DEBUG nova.compute.manager [req-ef9636a4-a3d0-4a8e-9e36-6f25c57b6e8b req-c3150457-495f-4813-ae16-6fb897930cb5 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] No waiting events found dispatching network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:45:48 user nova-compute[82196]: WARNING nova.compute.manager [req-ef9636a4-a3d0-4a8e-9e36-6f25c57b6e8b req-c3150457-495f-4813-ae16-6fb897930cb5 service nova] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Received unexpected event network-vif-plugged-1c929bc1-2708-4e38-80b3-354812ccb529 for instance with vm_state deleted and task_state None.
Apr 11 19:45:49 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'flavor' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:51 user nova-compute[82196]: INFO nova.compute.manager [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attaching volume 038ca727-7ccc-42a5-babc-99b70d2e4dea to /dev/vdb
Apr 11 19:45:51 user nova-compute[82196]: DEBUG os_brick.utils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b32126-d372-4211-b3f1-e879cd039c17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[807e8801-1f95-4421-81dc-bae6a4a715d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[beede2c9-211e-4106-8b72-20ccfdcb89ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[62265741-7d35-467b-8bec-8e83a8cc2ade]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:45:51 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:45:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4277bb15-feff-4a8c-8373-22dee28a11a1]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG os_brick.utils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:45:51 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updating existing volume attachment record: 0f9d0088-7141-4503-8b8f-e737a9d8c351 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycWLwOxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:45:55 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:45:55 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:45:55 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8dfd21-3db2-455e-ad2d-d75e0fed0f59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:45:55 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[62de0790-bcfa-40cc-908f-36d8e4b1df88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea] added
Apr 11 19:45:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0328a526-c45e-4f3d-8a35-adb68d003b54]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb42809-7d24-4464-8575-45ef7a7059ce]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycWLwOxZ {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycWLwOxZ" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f847972-ebbc-4886-9fd9-d30bf9de2e0c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycWLwOxZ'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[294aa364-f36f-4cbd-9646-679583966b57]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dcecb8-0745-4cb4-98e7-e371824d8a42]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:55 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:45:55 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:45:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:55 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:45:55 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:45:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57d1968-1504-46d9-93f9-f98a013cbe45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea, portal: 172.16.0.220,3260]
Apr 11 19:45:55 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea, portal: 172.16.0.220,3260] successful.
Apr 11 19:45:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5aa600f-48d6-4733-ae7e-c438af92a14e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2c1f17-023e-4113-ba74-64307e75797d]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:56 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:45:56 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:45:56 user nova-compute[82196]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea (non-flash)
Apr 11 19:45:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:56 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:45:56 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:45:56 user nova-compute[82196]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea (non-flash)
Apr 11 19:45:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[003204a3-4cca-4a60-904f-b7d63f948535]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycWLwOxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updating instance_info_cache with network_info: [{"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:45:56 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26338323761373139', 'path': '/dev/sde'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338323761373139', 'path': '/dev/sde'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'flavor' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:45:57 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:45:57 user nova-compute[82196]:   <source dev="/dev/sde"/>
Apr 11 19:45:57 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:45:57 user nova-compute[82196]:   <serial>038ca727-7ccc-42a5-babc-99b70d2e4dea</serial>
Apr 11 19:45:57 user nova-compute[82196]: </disk>
Apr 11 19:45:57 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No VIF found with MAC fa:16:3e:d3:a7:89, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ada272bc-b065-4312-a088-3b34a54089dc tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.095s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:45:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:45:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:45:58 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:45:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:58 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:59 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:45:59 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8092MB free_disk=26.263656616210938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:45:59 user nova-compute[82196]: INFO nova.compute.manager [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Detaching volume 038ca727-7ccc-42a5-babc-99b70d2e4dea
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Applying migration context for instance f633037d-87d0-4dda-aa33-3cc9c3191080 as it has an incoming, in-progress migration 3839b6ea-9b2e-4f67-9730-ef911fd3ecfb. Migration status is finished {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 19:45:59 user nova-compute[82196]: INFO nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updating resource usage from migration 3839b6ea-9b2e-4f67-9730-ef911fd3ecfb
Apr 11 19:45:59 user nova-compute[82196]: INFO nova.virt.block_device [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attempting to driver detach volume 038ca727-7ccc-42a5-babc-99b70d2e4dea from mountpoint /dev/vdb
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance a66c1d51-e194-424d-a37c-d308544774c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Migration 3839b6ea-9b2e-4f67-9730-ef911fd3ecfb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance f633037d-87d0-4dda-aa33-3cc9c3191080 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Attempting to detach device vdb from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:45:59 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:45:59 user nova-compute[82196]:   <source dev="/dev/sde"/>
Apr 11 19:45:59 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:45:59 user nova-compute[82196]:   <serial>038ca727-7ccc-42a5-babc-99b70d2e4dea</serial>
Apr 11 19:45:59 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:45:59 user nova-compute[82196]: </disk>
Apr 11 19:45:59 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:45:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Successfully detached device vdb from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the persistent domain config.
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:45:59 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:45:59 user nova-compute[82196]:   <source dev="/dev/sde"/>
Apr 11 19:45:59 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:45:59 user nova-compute[82196]:   <serial>038ca727-7ccc-42a5-babc-99b70d2e4dea</serial>
Apr 11 19:45:59 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:45:59 user nova-compute[82196]: </disk>
Apr 11 19:45:59 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681242359.5848591, 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:45:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Successfully detached device vdb from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the live domain config.
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycWLwOxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:45:59 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb966ea7-698c-475d-9d04-a6a528314fe5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:45:59 user nova-compute[82196]: No targets found.
Apr 11 19:45:59 user nova-compute[82196]: iSNS:
Apr 11 19:45:59 user nova-compute[82196]: No targets found.
Apr 11 19:45:59 user nova-compute[82196]: STATIC:
Apr 11 19:45:59 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811
Apr 11 19:45:59 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:45:59 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:45:59 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d
Apr 11 19:45:59 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:45:59 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:45:59 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037
Apr 11 19:45:59 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:45:59 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:45:59 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea
Apr 11 19:45:59 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:45:59 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:45:59 user nova-compute[82196]: FIRMWARE:
Apr 11 19:45:59 user nova-compute[82196]: No targets found.
Apr 11 19:45:59 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:45:59 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:45:59 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6250e3c-8f42-4dc2-bbdb-989d1d877b24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfb150c-96dd-4744-aebd-5989bd473793]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:59 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:45:59 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:45:59 user nova-compute[82196]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea (non-flash)
Apr 11 19:45:59 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:45:59 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:45:59 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:45:59 user nova-compute[82196]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea (non-flash)
Apr 11 19:45:59 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9274180820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea'): ({'sde'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Removing single pathed devices sde {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef04727-4bd7-4a2b-b468-62674261cb9c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee44494-22df-4cca-9023-1b4c8a76a709]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Flushing IO for device /dev/sde {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1dc317-0a64-4bca-809d-1778091c5f2d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e8ce33-802d-4a1a-aee7-e43c348536fc]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] SCSI volumes sde have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ab2c74-c74b-4aa9-b999-11e6394a9d36]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c7b128-30a6-4e7e-83b2-6303854cd099]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea, portal: 172.16.0.220,3260]
Apr 11 19:45:59 user nova-compute[82196]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea, portal: 172.16.0.220,3260] successful.
Apr 11 19:45:59 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038ca727-7ccc-42a5-babc-99b70d2e4dea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd744c3f-eb36-464c-b304-579e4e5f77e5]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] <== disconnect_volume: return (308ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:45:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:46:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:00 user nova-compute[82196]: DEBUG nova.objects.instance [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'flavor' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:46:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-df800ed7-04ee-48ca-b79a-ce0b75c0e537 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.686s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:46:01 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242346.2416198, 6f2616ce-4924-4b82-996a-2596ae8856a4 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:46:01 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] VM Stopped (Lifecycle Event)
Apr 11 19:46:01 user nova-compute[82196]: DEBUG nova.compute.manager [None req-cebd4e6c-fe67-4e04-90b2-1307162af409 None None] [instance: 6f2616ce-4924-4b82-996a-2596ae8856a4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:46:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:46:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:46:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:46:03 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:46:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:46:16 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:46:21 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:26 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:31 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:46:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:46:36 user nova-compute[82196]: INFO nova.compute.manager [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Terminating instance
Apr 11 19:46:36 user nova-compute[82196]: DEBUG nova.compute.manager [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-d5af9127-31ba-4649-ae53-5808f30ac3e4 req-30506e2c-3233-495e-93ff-65004a20b734 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-unplugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d5af9127-31ba-4649-ae53-5808f30ac3e4 req-30506e2c-3233-495e-93ff-65004a20b734 service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d5af9127-31ba-4649-ae53-5808f30ac3e4 req-30506e2c-3233-495e-93ff-65004a20b734 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d5af9127-31ba-4649-ae53-5808f30ac3e4 req-30506e2c-3233-495e-93ff-65004a20b734 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-d5af9127-31ba-4649-ae53-5808f30ac3e4 req-30506e2c-3233-495e-93ff-65004a20b734 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-unplugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-d5af9127-31ba-4649-ae53-5808f30ac3e4 req-30506e2c-3233-495e-93ff-65004a20b734 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-unplugged-06fea704-e356-4605-811e-aac91617290e for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:36 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Instance destroyed successfully.
Apr 11 19:46:36 user nova-compute[82196]: DEBUG nova.objects.instance [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lazy-loading 'resources' on Instance uuid 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-706054067',display_name='tempest-ServerRescueNegativeTestJSON-server-706054067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-706054067',id=25,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:34:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8e3a291c54b49db8e12a88ba41865e3',ramdisk_id='',reservation_id='r-zcw3jruw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1429831687',owner_user_name='tempest-ServerRescueNegativeTestJSON-1429831687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:36:31Z,user_data=None,user_id='ba7f82b529e74d99838b6264b94d823b',uuid=267c17c1-f0b6-4e18-8c18-5e5bbe8a2251,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converting VIF {"id": "06fea704-e356-4605-811e-aac91617290e", "address": "fa:16:3e:0f:f8:7f", "network": {"id": "c1382921-467f-4bd9-a91e-24ffb75a9553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1019845742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3a291c54b49db8e12a88ba41865e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fea704-e3", "ovs_interfaceid": "06fea704-e356-4605-811e-aac91617290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=06fea704-e356-4605-811e-aac91617290e,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fea704-e3') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG os_vif [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=06fea704-e356-4605-811e-aac91617290e,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fea704-e3') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06fea704-e3, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:46:36 user nova-compute[82196]: INFO os_vif [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:7f,bridge_name='br-int',has_traffic_filtering=True,id=06fea704-e356-4605-811e-aac91617290e,network=Network(c1382921-467f-4bd9-a91e-24ffb75a9553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fea704-e3')
Apr 11 19:46:36 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Deleting instance files /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251_del
Apr 11 19:46:36 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Deletion of /opt/stack/data/nova/instances/267c17c1-f0b6-4e18-8c18-5e5bbe8a2251_del complete
Apr 11 19:46:36 user nova-compute[82196]: INFO nova.compute.manager [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 11 19:46:36 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:46:36 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:46:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:37 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:46:37 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Took 0.72 seconds to deallocate network for instance.
Apr 11 19:46:37 user nova-compute[82196]: DEBUG nova.compute.manager [req-a3d24c82-df90-4e6e-bfae-2e518fbaf8c6 req-0819ac2e-177f-4964-8416-86a969d76c28 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-deleted-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:46:37 user nova-compute[82196]: INFO nova.compute.manager [req-a3d24c82-df90-4e6e-bfae-2e518fbaf8c6 req-0819ac2e-177f-4964-8416-86a969d76c28 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Neutron deleted interface 06fea704-e356-4605-811e-aac91617290e; detaching it from the instance and deleting it from the info cache
Apr 11 19:46:37 user nova-compute[82196]: DEBUG nova.network.neutron [req-a3d24c82-df90-4e6e-bfae-2e518fbaf8c6 req-0819ac2e-177f-4964-8416-86a969d76c28 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:46:37 user nova-compute[82196]: DEBUG nova.compute.manager [req-a3d24c82-df90-4e6e-bfae-2e518fbaf8c6 req-0819ac2e-177f-4964-8416-86a969d76c28 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Detach interface failed, port_id=06fea704-e356-4605-811e-aac91617290e, reason: Instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 could not be found. {{(pid=82196) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 19:46:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:46:37 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:46:37 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:46:37 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:46:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:46:38 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Deleted allocations for instance 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251
Apr 11 19:46:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-97847ca9-db33-4855-98c0-0e525bcb0c5d tempest-ServerRescueNegativeTestJSON-1429831687 tempest-ServerRescueNegativeTestJSON-1429831687-project-member] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.833s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:46:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:46:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:46:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:46:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:46:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:46:38 user nova-compute[82196]: WARNING nova.compute.manager [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received unexpected event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e for instance with vm_state deleted and task_state None.
Apr 11 19:46:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:46:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] Acquiring lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:46:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:46:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] Lock "267c17c1-f0b6-4e18-8c18-5e5bbe8a2251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:46:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] No waiting events found dispatching network-vif-plugged-06fea704-e356-4605-811e-aac91617290e {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:46:38 user nova-compute[82196]: WARNING nova.compute.manager [req-a4d11359-ef7e-4e71-93a0-73e682db54f4 req-717ac6ee-1088-48ef-b96e-407b18d3fa06 service nova] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Received unexpected event network-vif-plugged-06fea704-e356-4605-811e-aac91617290e for instance with vm_state deleted and task_state None.
Apr 11 19:46:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:41 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:46:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:46:44 user nova-compute[82196]: DEBUG nova.compute.manager [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Going to confirm migration 2 {{(pid=82196) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 11 19:46:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:46:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquired lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:46:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:46:45 user nova-compute[82196]: DEBUG nova.objects.instance [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'info_cache' on Instance uuid f633037d-87d0-4dda-aa33-3cc9c3191080 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:46:45 user nova-compute[82196]: DEBUG nova.network.neutron [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updating instance_info_cache with network_info: [{"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:46:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Releasing lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:46:45 user nova-compute[82196]: DEBUG nova.objects.instance [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'migration_context' on Instance uuid f633037d-87d0-4dda-aa33-3cc9c3191080 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:46:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:46:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:46:46 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:46:46 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:46:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.261s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:46:46 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Deleted allocation for migration 3839b6ea-9b2e-4f67-9730-ef911fd3ecfb
Apr 11 19:46:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0f3edeaa-188d-4e1e-84c7-eb660fa806cd tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.322s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:46:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:46:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:46:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:46:50 user nova-compute[82196]: DEBUG nova.objects.instance [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'flavor' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:46:51 user nova-compute[82196]: INFO nova.compute.manager [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attaching volume 207baeec-84ed-4c06-9ec9-ffa8bae0bac8 to /dev/vdb
Apr 11 19:46:51 user nova-compute[82196]: DEBUG os_brick.utils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d92ea3-fbb0-4444-8706-e222fc66668b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd1ba78-b441-4902-9bbc-0629121673cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5c477d-ca0d-4f07-be42-e381c537dbc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5241ed08-b7be-468b-a392-9b0bc29901a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:46:51 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7150db15-fc36-4dc7-9ae5-404ee3e7df2a]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG os_brick.utils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updating existing volume attachment record: 530fad28-9b1a-4550-ac12-2d15c02d876f {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242396.8461182, 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:46:51 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] VM Stopped (Lifecycle Event)
Apr 11 19:46:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-54daca48-8c0e-443e-a66f-5765bf491567 None None] [instance: 267c17c1-f0b6-4e18-8c18-5e5bbe8a2251] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:46:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:52 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgeoXDMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:46:55 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:46:55 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:46:55 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3e6a42-e12d-424c-81f6-118de1b31f4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:46:55 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e43f638-ee0c-4f31-8c74-aa00cf84bb0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8] added
Apr 11 19:46:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[21717e9a-57c9-4d94-a78d-4fcd8a6751ba]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26aad5c-2710-47f1-8aaa-91f70cbab476]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgeoXDMV {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgeoXDMV" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[96710485-eada-452c-be6b-03b6a2c8ecf2]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hgeoXDMV'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[030dfc9a-5fa0-4767-aba8-cd65f17d27da]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef51387-b97e-488f-9c7c-81e4dc5ee7bd]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:46:55 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:46:55 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:46:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:46:55 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:46:55 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:46:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3748879e-43d1-4d4a-8605-e63fa5eee3c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8, portal: 172.16.0.220,3260]
Apr 11 19:46:55 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8, portal: 172.16.0.220,3260] successful.
Apr 11 19:46:55 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:46:55 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[28400e9d-5a98-43d5-93a8-501777f94f01]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[179e7054-1181-4643-a4f8-31bb6721ee90]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:46:56 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:46:56 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:46:56 user nova-compute[82196]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 (non-flash)
Apr 11 19:46:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:46:56 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:46:56 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:46:56 user nova-compute[82196]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 (non-flash)
Apr 11 19:46:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b07641-3c30-405d-99ca-ab2857f033f7]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgeoXDMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Updating instance_info_cache with network_info: [{"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-478eb884-ba19-4a4b-b1eb-a2e59d6beef0" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:46:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:46:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:46:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23438366562393361', 'path': '/dev/sde'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:46:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438366562393361', 'path': '/dev/sde'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:46:57 user nova-compute[82196]: DEBUG nova.objects.instance [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'flavor' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:46:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:46:57 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:46:57 user nova-compute[82196]:   <source dev="/dev/sde"/>
Apr 11 19:46:57 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:46:57 user nova-compute[82196]:   <serial>207baeec-84ed-4c06-9ec9-ffa8bae0bac8</serial>
Apr 11 19:46:57 user nova-compute[82196]: </disk>
Apr 11 19:46:57 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:46:57 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:46:57 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:46:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:46:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:46:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] No VIF found with MAC fa:16:3e:d3:a7:89, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:46:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-536552a4-2d7a-44d2-bc4d-00845a5f44cf tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.726s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:46:59 user nova-compute[82196]: INFO nova.compute.manager [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Detaching volume 207baeec-84ed-4c06-9ec9-ffa8bae0bac8
Apr 11 19:46:59 user nova-compute[82196]: INFO nova.virt.block_device [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Attempting to driver detach volume 207baeec-84ed-4c06-9ec9-ffa8bae0bac8 from mountpoint /dev/vdb
Apr 11 19:46:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Attempting to detach device vdb from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:46:59 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:46:59 user nova-compute[82196]:   <source dev="/dev/sde"/>
Apr 11 19:46:59 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:46:59 user nova-compute[82196]:   <serial>207baeec-84ed-4c06-9ec9-ffa8bae0bac8</serial>
Apr 11 19:46:59 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:46:59 user nova-compute[82196]: </disk>
Apr 11 19:46:59 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:46:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Successfully detached device vdb from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the persistent domain config.
Apr 11 19:46:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:46:59 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:46:59 user nova-compute[82196]:   <source dev="/dev/sde"/>
Apr 11 19:46:59 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:46:59 user nova-compute[82196]:   <serial>207baeec-84ed-4c06-9ec9-ffa8bae0bac8</serial>
Apr 11 19:46:59 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 19:46:59 user nova-compute[82196]: </disk>
Apr 11 19:46:59 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681242419.806709, 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Successfully detached device vdb from instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 from the live domain config.
Apr 11 19:46:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgeoXDMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:46:59 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:46:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfae6bcd-a4b7-45af-925d-8f6cfc525c39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:46:59 user nova-compute[82196]: No targets found.
Apr 11 19:46:59 user nova-compute[82196]: iSNS:
Apr 11 19:46:59 user nova-compute[82196]: No targets found.
Apr 11 19:46:59 user nova-compute[82196]: STATIC:
Apr 11 19:46:59 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8
Apr 11 19:46:59 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:46:59 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:46:59 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811
Apr 11 19:46:59 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:46:59 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:46:59 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d
Apr 11 19:46:59 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:46:59 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:46:59 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037
Apr 11 19:46:59 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:46:59 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:46:59 user nova-compute[82196]: FIRMWARE:
Apr 11 19:46:59 user nova-compute[82196]: No targets found.
Apr 11 19:46:59 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:46:59 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:46:59 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49d26ac-9a05-48f0-a9c4-0ce072236c98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ce2335-abc3-4236-a816-16ca08fce5c5]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:46:59 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:46:59 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:46:59 user nova-compute[82196]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 (non-flash)
Apr 11 19:46:59 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:46:59 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:46:59 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:46:59 user nova-compute[82196]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 (non-flash)
Apr 11 19:46:59 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f927c1cb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8'): ({'sde'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Removing single pathed devices sde {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:46:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[93208f68-e9a7-4662-abf8-d0334a68a0b5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5e8471-2b80-42b9-9361-8966fd03ad0a]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Flushing IO for device /dev/sde {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d34bc6d-a815-4564-93a2-d0d5bff538f5]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fee02b6-b5d4-4aa8-a6c5-3c6e348eaba9]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] SCSI volumes sde have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[17733528-6768-41b0-8a66-a5208a679528]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[266c65fb-103e-45a8-8519-3328595e95df]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8, portal: 172.16.0.220,3260]
Apr 11 19:47:00 user nova-compute[82196]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8, portal: 172.16.0.220,3260] successful.
Apr 11 19:47:00 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207baeec-84ed-4c06-9ec9-ffa8bae0bac8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2346f5f7-a590-4d84-b7e7-25c950d630bc]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] <== disconnect_volume: return (367ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Received event network-changed-42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Refreshing instance network info cache due to event network-changed-42d318d4-06e2-42de-93b2-504f5a5a51e5. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] Acquiring lock "refresh_cache-589934d3-f72e-49d4-a230-1748ba0d5ee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] Acquired lock "refresh_cache-589934d3-f72e-49d4-a230-1748ba0d5ee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.network.neutron [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Refreshing network info cache for port 42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:47:00 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:47:00 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8289MB free_disk=26.270954132080078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance a66c1d51-e194-424d-a37c-d308544774c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance f633037d-87d0-4dda-aa33-3cc9c3191080 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 589934d3-f72e-49d4-a230-1748ba0d5ee2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:47:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:47:01 user nova-compute[82196]: DEBUG nova.objects.instance [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'flavor' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:47:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-880acfa4-c7ab-4d52-b14a-703a96579f93 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.863s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:01 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:47:01 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:47:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:47:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:01 user nova-compute[82196]: DEBUG nova.network.neutron [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Updated VIF entry in instance network info cache for port 42d318d4-06e2-42de-93b2-504f5a5a51e5. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:47:01 user nova-compute[82196]: DEBUG nova.network.neutron [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Updating instance_info_cache with network_info: [{"id": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "address": "fa:16:3e:e5:51:45", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d318d4-06", "ovs_interfaceid": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:47:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-406bfe28-4b8b-49a9-9910-cfaa20403f86 req-7f99c817-c0d5-4c1a-a943-5afff9c8ec93 service nova] Releasing lock "refresh_cache-589934d3-f72e-49d4-a230-1748ba0d5ee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:47:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Received event network-changed-42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Refreshing instance network info cache due to event network-changed-42d318d4-06e2-42de-93b2-504f5a5a51e5. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] Acquiring lock "refresh_cache-589934d3-f72e-49d4-a230-1748ba0d5ee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] Acquired lock "refresh_cache-589934d3-f72e-49d4-a230-1748ba0d5ee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG nova.network.neutron [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Refreshing network info cache for port 42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "589934d3-f72e-49d4-a230-1748ba0d5ee2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:02 user nova-compute[82196]: INFO nova.compute.manager [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Terminating instance
Apr 11 19:47:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG nova.network.neutron [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Updated VIF entry in instance network info cache for port 42d318d4-06e2-42de-93b2-504f5a5a51e5. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG nova.network.neutron [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Updating instance_info_cache with network_info: [{"id": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "address": "fa:16:3e:e5:51:45", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d318d4-06", "ovs_interfaceid": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:47:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-a4da0fbf-251e-4a6b-8aa0-c93b1bc5bc11 req-6db94353-c4c8-4a4e-a36a-01a37fd8fb77 service nova] Releasing lock "refresh_cache-589934d3-f72e-49d4-a230-1748ba0d5ee2" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:47:03 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Instance destroyed successfully.
Apr 11 19:47:03 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lazy-loading 'resources' on Instance uuid 589934d3-f72e-49d4-a230-1748ba0d5ee2 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-225631843',display_name='tempest-TestVolumeBootPattern-server-225631843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-225631843',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPal5dIOOTQX1AtimGkw05FO0Z9eaerqpiFYTxmlD5RcLLewnhLN4pAKWK7d0rX0zQgFYrr+JvrnM8AxIhiJUbrvnXCoFiGl5kaOegYnss1VivHpq7rMu1EVV1XJIRedHg==',key_name='tempest-TestVolumeBootPattern-1844027973',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:45:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-zvljxzxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:45:19Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=589934d3-f72e-49d4-a230-1748ba0d5ee2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "address": "fa:16:3e:e5:51:45", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d318d4-06", "ovs_interfaceid": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "address": "fa:16:3e:e5:51:45", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d318d4-06", "ovs_interfaceid": "42d318d4-06e2-42de-93b2-504f5a5a51e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:51:45,bridge_name='br-int',has_traffic_filtering=True,id=42d318d4-06e2-42de-93b2-504f5a5a51e5,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d318d4-06') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_vif [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:51:45,bridge_name='br-int',has_traffic_filtering=True,id=42d318d4-06e2-42de-93b2-504f5a5a51e5,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d318d4-06') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42d318d4-06, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:47:03 user nova-compute[82196]: INFO os_vif [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:51:45,bridge_name='br-int',has_traffic_filtering=True,id=42d318d4-06e2-42de-93b2-504f5a5a51e5,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d318d4-06')
Apr 11 19:47:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPyOLbUw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:47:03 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[70103479-8a30-4543-ac99-391278ac01f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:47:03 user nova-compute[82196]: No targets found.
Apr 11 19:47:03 user nova-compute[82196]: iSNS:
Apr 11 19:47:03 user nova-compute[82196]: No targets found.
Apr 11 19:47:03 user nova-compute[82196]: STATIC:
Apr 11 19:47:03 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811
Apr 11 19:47:03 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:47:03 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:47:03 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d
Apr 11 19:47:03 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:47:03 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:47:03 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037
Apr 11 19:47:03 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:47:03 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:47:03 user nova-compute[82196]: FIRMWARE:
Apr 11 19:47:03 user nova-compute[82196]: No targets found.
Apr 11 19:47:03 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:47:03 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:47:03 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2681b333-907f-49a9-bba2-3ef1ad644e87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a165f10-b4ce-401e-9eb7-12cfdfbd63d6]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:47:03 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:47:03 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:47:03 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:47:03 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:47:03 user nova-compute[82196]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 (non-flash)
Apr 11 19:47:03 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92741835b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811'): ({'sdc'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Removing single pathed devices sdc {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bec114-a28f-40a1-87a4-b436a4c74c74]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[89829ef3-9160-4bb6-83a3-b15dd58718c3]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flushing IO for device /dev/sdc {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce2c11a-51aa-41ee-a772-477826d690bf]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c4fe5-16dd-47cd-83e6-2a0e76b14063]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] SCSI volumes sdc have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e64c64-52a1-466c-a3e8-052efd457e58]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0e861a-0674-442f-82d6-186167bc21fa]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811, portal: 172.16.0.220,3260]
Apr 11 19:47:03 user nova-compute[82196]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811, portal: 172.16.0.220,3260] successful.
Apr 11 19:47:03 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d92e8c90-19c1-484b-8294-655686396811 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b034afae-bf79-4db3-a34d-29cc806f18fd]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== disconnect_volume: return (330ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:47:03 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Deleting instance files /opt/stack/data/nova/instances/589934d3-f72e-49d4-a230-1748ba0d5ee2_del
Apr 11 19:47:03 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Deletion of /opt/stack/data/nova/instances/589934d3-f72e-49d4-a230-1748ba0d5ee2_del complete
Apr 11 19:47:03 user nova-compute[82196]: INFO nova.compute.manager [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 11 19:47:03 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:47:03 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:47:04 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Took 0.50 seconds to deallocate network for instance.
Apr 11 19:47:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-010500e4-d036-4e77-8fe8-f672c7605eca req-ced4f526-1581-4bd8-98e8-ed656a86d433 service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Received event network-vif-deleted-42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Received event network-vif-unplugged-42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] Acquiring lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] No waiting events found dispatching network-vif-unplugged-42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Received event network-vif-unplugged-42d318d4-06e2-42de-93b2-504f5a5a51e5 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Received event network-vif-plugged-42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] Acquiring lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG nova.compute.manager [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] No waiting events found dispatching network-vif-plugged-42d318d4-06e2-42de-93b2-504f5a5a51e5 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:47:04 user nova-compute[82196]: WARNING nova.compute.manager [req-bf18f577-9ad4-41d7-9752-274b1dba6f73 req-d7a43f8b-9e4e-4e97-b1cf-cb3ff052d73b service nova] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Received unexpected event network-vif-plugged-42d318d4-06e2-42de-93b2-504f5a5a51e5 for instance with vm_state active and task_state deleting.
Apr 11 19:47:04 user nova-compute[82196]: INFO nova.compute.manager [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Took 0.73 seconds to detach 1 volumes for instance.
Apr 11 19:47:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:05 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:47:05 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:47:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:05 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Deleted allocations for instance 589934d3-f72e-49d4-a230-1748ba0d5ee2
Apr 11 19:47:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6cda8961-537a-48f1-8d4a-c39fbf704fd2 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "589934d3-f72e-49d4-a230-1748ba0d5ee2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.825s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:18 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242423.1805658, 589934d3-f72e-49d4-a230-1748ba0d5ee2 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:47:18 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] VM Stopped (Lifecycle Event)
Apr 11 19:47:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-669592ff-d205-45c5-9f12-fa820c9a2e2c None None] [instance: 589934d3-f72e-49d4-a230-1748ba0d5ee2] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:47:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:47:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:47:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:47:49 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:47:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:49 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:47:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:49 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:47:49 user nova-compute[82196]: INFO nova.compute.claims [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Claim successful on node user
Apr 11 19:47:49 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:47:49 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:47:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:49 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG nova.network.neutron [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:47:50 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:47:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG nova.policy [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98feebb43745423299d602c50d09d982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b09d8c9ff94045a36fdc454f8875e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:47:50 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Creating image(s)
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "/opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "/opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "83e681eaac3001e5271a806d2430b36aff39d7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9,backing_fmt=raw /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk 1073741824" returned: 0 in 0.060s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "83e681eaac3001e5271a806d2430b36aff39d7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9 --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG nova.network.neutron [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Successfully created port: 91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Cannot resize image /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG nova.objects.instance [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lazy-loading 'migration_context' on Instance uuid e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Ensure instance console log exists: /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Successfully updated port: 91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "refresh_cache-e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquired lock "refresh_cache-e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.compute.manager [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Received event network-changed-91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.compute.manager [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Refreshing instance network info cache due to event network-changed-91ae7fad-1a68-4881-8048-4fab8fcfe90a. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] Acquiring lock "refresh_cache-e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.network.neutron [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Updating instance_info_cache with network_info: [{"id": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "address": "fa:16:3e:e4:ed:7c", "network": {"id": "50e7af77-f722-402c-963f-0bfb77a025f7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1745886981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "56b09d8c9ff94045a36fdc454f8875e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ae7fad-1a", "ovs_interfaceid": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Releasing lock "refresh_cache-e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Instance network_info: |[{"id": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "address": "fa:16:3e:e4:ed:7c", "network": {"id": "50e7af77-f722-402c-963f-0bfb77a025f7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1745886981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "56b09d8c9ff94045a36fdc454f8875e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ae7fad-1a", "ovs_interfaceid": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] Acquired lock "refresh_cache-e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.network.neutron [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Refreshing network info cache for port 91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Start _get_guest_xml network_info=[{"id": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "address": "fa:16:3e:e4:ed:7c", "network": {"id": "50e7af77-f722-402c-963f-0bfb77a025f7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1745886981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "56b09d8c9ff94045a36fdc454f8875e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ae7fad-1a", "ovs_interfaceid": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:47:51 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:47:51 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:17:54Z,direct_url=<?>,disk_format='qcow2',id=4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fbdf09eea41f454e9a1bb9864af731dd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:47:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-467460675',display_name='tempest-VolumesActionsTest-instance-467460675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-467460675',id=45,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56b09d8c9ff94045a36fdc454f8875e8',ramdisk_id='',reservation_id='r-04b7tgh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-283035711',owner_user_name='tempest-VolumesActionsTest-283035711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:47:50Z,user_data=None,user_id='98feebb43745423299d602c50d09d982',uuid=e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "address": "fa:16:3e:e4:ed:7c", "network": {"id": "50e7af77-f722-402c-963f-0bfb77a025f7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1745886981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "56b09d8c9ff94045a36fdc454f8875e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ae7fad-1a", "ovs_interfaceid": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Converting VIF {"id": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "address": "fa:16:3e:e4:ed:7c", "network": {"id": "50e7af77-f722-402c-963f-0bfb77a025f7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1745886981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "56b09d8c9ff94045a36fdc454f8875e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ae7fad-1a", "ovs_interfaceid": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ed:7c,bridge_name='br-int',has_traffic_filtering=True,id=91ae7fad-1a68-4881-8048-4fab8fcfe90a,network=Network(50e7af77-f722-402c-963f-0bfb77a025f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ae7fad-1a') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:47:51 user nova-compute[82196]: DEBUG nova.objects.instance [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lazy-loading 'pci_devices' on Instance uuid e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:47:52 user nova-compute[82196]:   <uuid>e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04</uuid>
Apr 11 19:47:52 user nova-compute[82196]:   <name>instance-0000002d</name>
Apr 11 19:47:52 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:47:52 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:47:52 user nova-compute[82196]:   <metadata>
Apr 11 19:47:52 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:47:52 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:47:52 user nova-compute[82196]:       <nova:name>tempest-VolumesActionsTest-instance-467460675</nova:name>
Apr 11 19:47:52 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:47:51</nova:creationTime>
Apr 11 19:47:52 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:47:52 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:47:52 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:47:52 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:47:52 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:47:52 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:47:52 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:47:52 user nova-compute[82196]:       <nova:owner>
Apr 11 19:47:52 user nova-compute[82196]:         <nova:user uuid="98feebb43745423299d602c50d09d982">tempest-VolumesActionsTest-283035711-project-member</nova:user>
Apr 11 19:47:52 user nova-compute[82196]:         <nova:project uuid="56b09d8c9ff94045a36fdc454f8875e8">tempest-VolumesActionsTest-283035711</nova:project>
Apr 11 19:47:52 user nova-compute[82196]:       </nova:owner>
Apr 11 19:47:52 user nova-compute[82196]:       <nova:root type="image" uuid="4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b"/>
Apr 11 19:47:52 user nova-compute[82196]:       <nova:ports>
Apr 11 19:47:52 user nova-compute[82196]:         <nova:port uuid="91ae7fad-1a68-4881-8048-4fab8fcfe90a">
Apr 11 19:47:52 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 19:47:52 user nova-compute[82196]:         </nova:port>
Apr 11 19:47:52 user nova-compute[82196]:       </nova:ports>
Apr 11 19:47:52 user nova-compute[82196]:     </nova:instance>
Apr 11 19:47:52 user nova-compute[82196]:   </metadata>
Apr 11 19:47:52 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:47:52 user nova-compute[82196]:     <system>
Apr 11 19:47:52 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:47:52 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:47:52 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:47:52 user nova-compute[82196]:       <entry name="serial">e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04</entry>
Apr 11 19:47:52 user nova-compute[82196]:       <entry name="uuid">e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04</entry>
Apr 11 19:47:52 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:47:52 user nova-compute[82196]:     </system>
Apr 11 19:47:52 user nova-compute[82196]:   </sysinfo>
Apr 11 19:47:52 user nova-compute[82196]:   <os>
Apr 11 19:47:52 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:47:52 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:47:52 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:47:52 user nova-compute[82196]:   </os>
Apr 11 19:47:52 user nova-compute[82196]:   <features>
Apr 11 19:47:52 user nova-compute[82196]:     <acpi/>
Apr 11 19:47:52 user nova-compute[82196]:     <apic/>
Apr 11 19:47:52 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:47:52 user nova-compute[82196]:   </features>
Apr 11 19:47:52 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:47:52 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:47:52 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:47:52 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:47:52 user nova-compute[82196]:   </clock>
Apr 11 19:47:52 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:47:52 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:47:52 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:47:52 user nova-compute[82196]:   </cpu>
Apr 11 19:47:52 user nova-compute[82196]:   <devices>
Apr 11 19:47:52 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:47:52 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:47:52 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk"/>
Apr 11 19:47:52 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:47:52 user nova-compute[82196]:     </disk>
Apr 11 19:47:52 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:47:52 user nova-compute[82196]:       <mac address="fa:16:3e:e4:ed:7c"/>
Apr 11 19:47:52 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:47:52 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:47:52 user nova-compute[82196]:       <target dev="tap91ae7fad-1a"/>
Apr 11 19:47:52 user nova-compute[82196]:     </interface>
Apr 11 19:47:52 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:47:52 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/console.log" append="off"/>
Apr 11 19:47:52 user nova-compute[82196]:     </serial>
Apr 11 19:47:52 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:47:52 user nova-compute[82196]:     <video>
Apr 11 19:47:52 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:47:52 user nova-compute[82196]:     </video>
Apr 11 19:47:52 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:47:52 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:47:52 user nova-compute[82196]:     </rng>
Apr 11 19:47:52 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:47:52 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:47:52 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:47:52 user nova-compute[82196]:     </memballoon>
Apr 11 19:47:52 user nova-compute[82196]:   </devices>
Apr 11 19:47:52 user nova-compute[82196]: </domain>
Apr 11 19:47:52 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:47:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-467460675',display_name='tempest-VolumesActionsTest-instance-467460675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-467460675',id=45,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56b09d8c9ff94045a36fdc454f8875e8',ramdisk_id='',reservation_id='r-04b7tgh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-283035711',owner_user_name='tempest-VolumesActionsTest-283035711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:47:50Z,user_data=None,user_id='98feebb43745423299d602c50d09d982',uuid=e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "address": "fa:16:3e:e4:ed:7c", "network": {"id": "50e7af77-f722-402c-963f-0bfb77a025f7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1745886981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "56b09d8c9ff94045a36fdc454f8875e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ae7fad-1a", "ovs_interfaceid": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Converting VIF {"id": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "address": "fa:16:3e:e4:ed:7c", "network": {"id": "50e7af77-f722-402c-963f-0bfb77a025f7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1745886981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "56b09d8c9ff94045a36fdc454f8875e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ae7fad-1a", "ovs_interfaceid": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ed:7c,bridge_name='br-int',has_traffic_filtering=True,id=91ae7fad-1a68-4881-8048-4fab8fcfe90a,network=Network(50e7af77-f722-402c-963f-0bfb77a025f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ae7fad-1a') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG os_vif [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ed:7c,bridge_name='br-int',has_traffic_filtering=True,id=91ae7fad-1a68-4881-8048-4fab8fcfe90a,network=Network(50e7af77-f722-402c-963f-0bfb77a025f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ae7fad-1a') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91ae7fad-1a, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91ae7fad-1a, col_values=(('external_ids', {'iface-id': '91ae7fad-1a68-4881-8048-4fab8fcfe90a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:ed:7c', 'vm-uuid': 'e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:52 user nova-compute[82196]: INFO os_vif [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ed:7c,bridge_name='br-int',has_traffic_filtering=True,id=91ae7fad-1a68-4881-8048-4fab8fcfe90a,network=Network(50e7af77-f722-402c-963f-0bfb77a025f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ae7fad-1a')
Apr 11 19:47:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] No VIF found with MAC fa:16:3e:e4:ed:7c, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG nova.network.neutron [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Updated VIF entry in instance network info cache for port 91ae7fad-1a68-4881-8048-4fab8fcfe90a. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG nova.network.neutron [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Updating instance_info_cache with network_info: [{"id": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "address": "fa:16:3e:e4:ed:7c", "network": {"id": "50e7af77-f722-402c-963f-0bfb77a025f7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1745886981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "56b09d8c9ff94045a36fdc454f8875e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ae7fad-1a", "ovs_interfaceid": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:47:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e3fc8356-5ab2-4944-a496-0f6ade81f9b0 req-664044fe-6641-4482-9032-f6dece245d9b service nova] Releasing lock "refresh_cache-e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:47:53 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:47:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-7ca11c1e-2975-46bb-997e-9da8838b8fc7 req-a4dacb5c-9efa-4975-96cd-8fdb330ed640 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Received event network-vif-plugged-91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7ca11c1e-2975-46bb-997e-9da8838b8fc7 req-a4dacb5c-9efa-4975-96cd-8fdb330ed640 service nova] Acquiring lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7ca11c1e-2975-46bb-997e-9da8838b8fc7 req-a4dacb5c-9efa-4975-96cd-8fdb330ed640 service nova] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7ca11c1e-2975-46bb-997e-9da8838b8fc7 req-a4dacb5c-9efa-4975-96cd-8fdb330ed640 service nova] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-7ca11c1e-2975-46bb-997e-9da8838b8fc7 req-a4dacb5c-9efa-4975-96cd-8fdb330ed640 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] No waiting events found dispatching network-vif-plugged-91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:47:53 user nova-compute[82196]: WARNING nova.compute.manager [req-7ca11c1e-2975-46bb-997e-9da8838b8fc7 req-a4dacb5c-9efa-4975-96cd-8fdb330ed640 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Received unexpected event network-vif-plugged-91ae7fad-1a68-4881-8048-4fab8fcfe90a for instance with vm_state building and task_state spawning.
Apr 11 19:47:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242475.6484225, e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:47:55 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] VM Resumed (Lifecycle Event)
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:47:55 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Instance spawned successfully.
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:47:55 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242475.6520424, e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:47:55 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] VM Started (Lifecycle Event)
Apr 11 19:47:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a66c1d51-e194-424d-a37c-d308544774c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a66c1d51-e194-424d-a37c-d308544774c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "a66c1d51-e194-424d-a37c-d308544774c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a66c1d51-e194-424d-a37c-d308544774c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a66c1d51-e194-424d-a37c-d308544774c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:55 user nova-compute[82196]: INFO nova.compute.manager [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Terminating instance
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Received event network-vif-plugged-91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] Acquiring lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] No waiting events found dispatching network-vif-plugged-91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:47:55 user nova-compute[82196]: WARNING nova.compute.manager [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Received unexpected event network-vif-plugged-91ae7fad-1a68-4881-8048-4fab8fcfe90a for instance with vm_state building and task_state spawning.
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Received event network-changed-397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Refreshing instance network info cache due to event network-changed-397ebb82-45b3-41ad-bbac-ef07140bf942. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] Acquiring lock "refresh_cache-a66c1d51-e194-424d-a37c-d308544774c6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] Acquired lock "refresh_cache-a66c1d51-e194-424d-a37c-d308544774c6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.network.neutron [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Refreshing network info cache for port 397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:47:55 user nova-compute[82196]: INFO nova.compute.manager [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Took 5.58 seconds to spawn the instance on the hypervisor.
Apr 11 19:47:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:47:55 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:47:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:55 user nova-compute[82196]: INFO nova.compute.manager [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Took 6.24 seconds to build instance.
Apr 11 19:47:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-fd54712e-6190-4c63-8130-52c820e12c75 tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.350s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-20ce2f9d-2153-416d-b977-ffa434d7d433 req-3ec4c70f-28ec-412f-b65b-bcf8b6212191 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Received event network-vif-unplugged-397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-20ce2f9d-2153-416d-b977-ffa434d7d433 req-3ec4c70f-28ec-412f-b65b-bcf8b6212191 service nova] Acquiring lock "a66c1d51-e194-424d-a37c-d308544774c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-20ce2f9d-2153-416d-b977-ffa434d7d433 req-3ec4c70f-28ec-412f-b65b-bcf8b6212191 service nova] Lock "a66c1d51-e194-424d-a37c-d308544774c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-20ce2f9d-2153-416d-b977-ffa434d7d433 req-3ec4c70f-28ec-412f-b65b-bcf8b6212191 service nova] Lock "a66c1d51-e194-424d-a37c-d308544774c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-20ce2f9d-2153-416d-b977-ffa434d7d433 req-3ec4c70f-28ec-412f-b65b-bcf8b6212191 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] No waiting events found dispatching network-vif-unplugged-397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-20ce2f9d-2153-416d-b977-ffa434d7d433 req-3ec4c70f-28ec-412f-b65b-bcf8b6212191 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Received event network-vif-unplugged-397ebb82-45b3-41ad-bbac-ef07140bf942 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG nova.network.neutron [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Updated VIF entry in instance network info cache for port 397ebb82-45b3-41ad-bbac-ef07140bf942. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG nova.network.neutron [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Updating instance_info_cache with network_info: [{"id": "397ebb82-45b3-41ad-bbac-ef07140bf942", "address": "fa:16:3e:33:3a:fc", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ebb82-45", "ovs_interfaceid": "397ebb82-45b3-41ad-bbac-ef07140bf942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-caab2910-f655-48be-8875-9fd73d4966b4 req-076fc1f5-04b3-43c1-acd2-888d910c3898 service nova] Releasing lock "refresh_cache-a66c1d51-e194-424d-a37c-d308544774c6" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:56 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Instance destroyed successfully.
Apr 11 19:47:56 user nova-compute[82196]: DEBUG nova.objects.instance [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lazy-loading 'resources' on Instance uuid a66c1d51-e194-424d-a37c-d308544774c6 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-189754775',display_name='tempest-TestVolumeBootPattern-server-189754775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-189754775',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPal5dIOOTQX1AtimGkw05FO0Z9eaerqpiFYTxmlD5RcLLewnhLN4pAKWK7d0rX0zQgFYrr+JvrnM8AxIhiJUbrvnXCoFiGl5kaOegYnss1VivHpq7rMu1EVV1XJIRedHg==',key_name='tempest-TestVolumeBootPattern-1844027973',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:43:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2caba0618fc743e7bfb2dd866a511df9',ramdisk_id='',reservation_id='r-8jw46fry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-935343500',owner_user_name='tempest-TestVolumeBootPattern-935343500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:43:24Z,user_data=None,user_id='cf262cd03f4a41c4956d8784cf37d86d',uuid=a66c1d51-e194-424d-a37c-d308544774c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "397ebb82-45b3-41ad-bbac-ef07140bf942", "address": "fa:16:3e:33:3a:fc", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ebb82-45", "ovs_interfaceid": "397ebb82-45b3-41ad-bbac-ef07140bf942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converting VIF {"id": "397ebb82-45b3-41ad-bbac-ef07140bf942", "address": "fa:16:3e:33:3a:fc", "network": {"id": "f22e45e9-cc15-401e-aed7-3506278d3d0d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134993690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2caba0618fc743e7bfb2dd866a511df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ebb82-45", "ovs_interfaceid": "397ebb82-45b3-41ad-bbac-ef07140bf942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:fc,bridge_name='br-int',has_traffic_filtering=True,id=397ebb82-45b3-41ad-bbac-ef07140bf942,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ebb82-45') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_vif [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:fc,bridge_name='br-int',has_traffic_filtering=True,id=397ebb82-45b3-41ad-bbac-ef07140bf942,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ebb82-45') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap397ebb82-45, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:47:56 user nova-compute[82196]: INFO os_vif [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:fc,bridge_name='br-int',has_traffic_filtering=True,id=397ebb82-45b3-41ad-bbac-ef07140bf942,network=Network(f22e45e9-cc15-401e-aed7-3506278d3d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ebb82-45')
Apr 11 19:47:56 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwEJArRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:47:56 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe16a06d-3357-444f-8fc2-438c9de08924]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:47:56 user nova-compute[82196]: No targets found.
Apr 11 19:47:56 user nova-compute[82196]: iSNS:
Apr 11 19:47:56 user nova-compute[82196]: No targets found.
Apr 11 19:47:56 user nova-compute[82196]: STATIC:
Apr 11 19:47:56 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d
Apr 11 19:47:56 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:47:56 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:47:56 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037
Apr 11 19:47:56 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:47:56 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:47:56 user nova-compute[82196]: FIRMWARE:
Apr 11 19:47:56 user nova-compute[82196]: No targets found.
Apr 11 19:47:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:47:56 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:47:56 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fc6a11-c954-402a-8d56-2a8cdbc32371]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d74c84f-357d-420d-be19-f19d5a18b749]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:47:56 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:47:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 (non-flash)
Apr 11 19:47:56 user nova-compute[82196]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:47:56 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92404cd1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037'): ({'sdd'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Removing single pathed devices sdd {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[353cad9f-2809-4204-96db-c6ff94cfe967]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e0d789-fe08-4f6a-93ee-2d2df89a4fdb]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Flushing IO for device /dev/sdd {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72cd6e2-4623-478b-8f34-6a7be845f963]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:47:56 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.065s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[117e21c0-c0e0-42a5-986c-5e732d8ce702]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] SCSI volumes sdd have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[51791870-8b42-4b92-a7fb-d85eae4ffc75]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[beda546e-1805-424a-89d1-9efc32b81ee0]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260]
Apr 11 19:47:57 user nova-compute[82196]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037, portal: 172.16.0.220,3260] successful.
Apr 11 19:47:57 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3920bc-0034-4875-be3a-b25fe27ee037 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a444381a-6719-4ad4-8840-555b1f645e33]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] <== disconnect_volume: return (339ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:47:57 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Deleting instance files /opt/stack/data/nova/instances/a66c1d51-e194-424d-a37c-d308544774c6_del
Apr 11 19:47:57 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Deletion of /opt/stack/data/nova/instances/a66c1d51-e194-424d-a37c-d308544774c6_del complete
Apr 11 19:47:57 user nova-compute[82196]: INFO nova.compute.manager [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Took 1.45 seconds to destroy the instance on the hypervisor.
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: a66c1d51-e194-424d-a37c-d308544774c6] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Received event network-changed-8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG nova.compute.manager [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Refreshing instance network info cache due to event network-changed-8d43789b-e200-409a-b819-09dd85859b3c. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] Acquiring lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:47:57 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:47:57 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Took 0.79 seconds to deallocate network for instance.
Apr 11 19:47:57 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updating instance_info_cache with network_info: [{"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] Acquired lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG nova.network.neutron [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Refreshing network info cache for port 8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-25c64154-8861-47ca-bcaf-3d8c8bec3f40 req-762493a1-0208-4ed6-8d31-783200a6bcfd service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Received event network-vif-plugged-397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-25c64154-8861-47ca-bcaf-3d8c8bec3f40 req-762493a1-0208-4ed6-8d31-783200a6bcfd service nova] Acquiring lock "a66c1d51-e194-424d-a37c-d308544774c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-25c64154-8861-47ca-bcaf-3d8c8bec3f40 req-762493a1-0208-4ed6-8d31-783200a6bcfd service nova] Lock "a66c1d51-e194-424d-a37c-d308544774c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-25c64154-8861-47ca-bcaf-3d8c8bec3f40 req-762493a1-0208-4ed6-8d31-783200a6bcfd service nova] Lock "a66c1d51-e194-424d-a37c-d308544774c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-25c64154-8861-47ca-bcaf-3d8c8bec3f40 req-762493a1-0208-4ed6-8d31-783200a6bcfd service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] No waiting events found dispatching network-vif-plugged-397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:47:58 user nova-compute[82196]: WARNING nova.compute.manager [req-25c64154-8861-47ca-bcaf-3d8c8bec3f40 req-762493a1-0208-4ed6-8d31-783200a6bcfd service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Received unexpected event network-vif-plugged-397ebb82-45b3-41ad-bbac-ef07140bf942 for instance with vm_state active and task_state deleting.
Apr 11 19:47:58 user nova-compute[82196]: DEBUG nova.network.neutron [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updated VIF entry in instance network info cache for port 8d43789b-e200-409a-b819-09dd85859b3c. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG nova.network.neutron [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updating instance_info_cache with network_info: [{"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cbabc95-39b5-4236-a335-72be11e34308 req-388fabd1-dcf4-43e7-be72-dc64a7bf552c service nova] Releasing lock "refresh_cache-6b110aaa-0f26-4bab-8f3e-d22edb5a5072" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:47:58 user nova-compute[82196]: INFO nova.compute.manager [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Took 0.86 seconds to detach 1 volumes for instance.
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:59 user nova-compute[82196]: INFO nova.compute.manager [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Terminating instance
Apr 11 19:47:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:59 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Deleted allocations for instance a66c1d51-e194-424d-a37c-d308544774c6
Apr 11 19:47:59 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc6c-e591-4515-aac3-0472888a2362 tempest-TestVolumeBootPattern-935343500 tempest-TestVolumeBootPattern-935343500-project-member] Lock "a66c1d51-e194-424d-a37c-d308544774c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.725s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:47:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Instance destroyed successfully.
Apr 11 19:47:59 user nova-compute[82196]: DEBUG nova.objects.instance [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lazy-loading 'resources' on Instance uuid 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1913437665',display_name='tempest-SnapshotDataIntegrityTests-server-1913437665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1913437665',id=41,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgEnKjXODkrVP1I9vap7nSk4UwAXw+9cEJPR3Eefq/qUJABtSOM4npeL0Yt2cWOu+Tp/Uq09/jE2WIlZvjGNjfzD5vmuG/JOIfRKdnSH0rl79lcIxVns70WcKMtDpBn1g==',key_name='tempest-SnapshotDataIntegrityTests-234136439',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:42:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27f0373f7bf54eb8845340bd4e931ab2',ramdisk_id='',reservation_id='r-7k037c3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-450067073',owner_user_name='tempest-SnapshotDataIntegrityTests-450067073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:42:01Z,user_data=None,user_id='9b2a4a06b5354121ae49d85be8b02458',uuid=6b110aaa-0f26-4bab-8f3e-d22edb5a5072,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Converting VIF {"id": "8d43789b-e200-409a-b819-09dd85859b3c", "address": "fa:16:3e:d3:a7:89", "network": {"id": "41cb581c-8f02-42e0-ab09-bcc05d4aa23c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-626196450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f0373f7bf54eb8845340bd4e931ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d43789b-e2", "ovs_interfaceid": "8d43789b-e200-409a-b819-09dd85859b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:a7:89,bridge_name='br-int',has_traffic_filtering=True,id=8d43789b-e200-409a-b819-09dd85859b3c,network=Network(41cb581c-8f02-42e0-ab09-bcc05d4aa23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d43789b-e2') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG os_vif [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:a7:89,bridge_name='br-int',has_traffic_filtering=True,id=8d43789b-e200-409a-b819-09dd85859b3c,network=Network(41cb581c-8f02-42e0-ab09-bcc05d4aa23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d43789b-e2') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d43789b-e2, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:47:59 user nova-compute[82196]: INFO os_vif [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:a7:89,bridge_name='br-int',has_traffic_filtering=True,id=8d43789b-e200-409a-b819-09dd85859b3c,network=Network(41cb581c-8f02-42e0-ab09-bcc05d4aa23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d43789b-e2')
Apr 11 19:47:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Deleting instance files /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072_del
Apr 11 19:47:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Deletion of /opt/stack/data/nova/instances/6b110aaa-0f26-4bab-8f3e-d22edb5a5072_del complete
Apr 11 19:47:59 user nova-compute[82196]: DEBUG nova.compute.manager [req-d6f6da33-977e-45b8-8485-42b42640c4ad req-b7027189-aadb-4b6c-95ce-f886ca65cd60 service nova] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Received event network-vif-deleted-397ebb82-45b3-41ad-bbac-ef07140bf942 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:47:59 user nova-compute[82196]: INFO nova.compute.manager [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 19:47:59 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:47:59 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:47:59 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Error from libvirt while getting description of instance-00000029: [Error Code 42] Domain not found: no domain with matching uuid '6b110aaa-0f26-4bab-8f3e-d22edb5a5072' (instance-00000029): libvirt.libvirtError: Domain not found: no domain with matching uuid '6b110aaa-0f26-4bab-8f3e-d22edb5a5072' (instance-00000029)
Apr 11 19:47:59 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Received event network-vif-unplugged-8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] No waiting events found dispatching network-vif-unplugged-8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Received event network-vif-unplugged-8d43789b-e200-409a-b819-09dd85859b3c for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Received event network-vif-plugged-8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] Acquiring lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] No waiting events found dispatching network-vif-plugged-8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:48:00 user nova-compute[82196]: WARNING nova.compute.manager [req-4743f6f6-9b21-4036-9efe-7f46bf22470f req-650dfef6-7e76-47e5-a6e8-8e3dd346ec8a service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Received unexpected event network-vif-plugged-8d43789b-e200-409a-b819-09dd85859b3c for instance with vm_state active and task_state deleting.
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:48:00 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Took 0.59 seconds to deallocate network for instance.
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:48:00 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:48:00 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:48:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8428MB free_disk=26.266769409179688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Refreshing inventories for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Updating ProviderTree inventory for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Updating inventory in ProviderTree for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 19:48:00 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Refreshing aggregate associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, aggregates: None {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Refreshing trait associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.660s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.324s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:48:01 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Deleted allocations for instance 6b110aaa-0f26-4bab-8f3e-d22edb5a5072
Apr 11 19:48:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance f633037d-87d0-4dda-aa33-3cc9c3191080 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-a38fc98d-8d97-47a6-81a1-9e257caf29d3 tempest-SnapshotDataIntegrityTests-450067073 tempest-SnapshotDataIntegrityTests-450067073-project-member] Lock "6b110aaa-0f26-4bab-8f3e-d22edb5a5072" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.307s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:48:01 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:48:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-b4b7f577-1abc-4611-84e1-a763105d7bea req-dd79c773-2488-466c-9728-0444d8ca5836 service nova] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Received event network-vif-deleted-8d43789b-e200-409a-b819-09dd85859b3c {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:48:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:48:03 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:48:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:05 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:48:05 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:48:05 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82196) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 19:48:06 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:48:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:11 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242476.7245328, a66c1d51-e194-424d-a37c-d308544774c6 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:48:11 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: a66c1d51-e194-424d-a37c-d308544774c6] VM Stopped (Lifecycle Event)
Apr 11 19:48:11 user nova-compute[82196]: DEBUG nova.compute.manager [None req-4a6f4d65-ef02-41b7-8590-eedb02e4e3b2 None None] [instance: a66c1d51-e194-424d-a37c-d308544774c6] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:48:13 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:48:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 19:48:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] There are 0 instances to clean {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 19:48:14 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242479.7705944, 6b110aaa-0f26-4bab-8f3e-d22edb5a5072 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:48:14 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] VM Stopped (Lifecycle Event)
Apr 11 19:48:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-9d9c5e35-ce78-4ab2-b5a3-d9fca9021732 None None] [instance: 6b110aaa-0f26-4bab-8f3e-d22edb5a5072] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:48:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:48:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid f633037d-87d0-4dda-aa33-3cc9c3191080 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:48:26 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:48:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:48:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:48:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:48:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:48:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:35 user nova-compute[82196]: INFO nova.compute.manager [None req-0a81e670-49ec-4588-a7b8-79fd5cf6f76a tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Get console output
Apr 11 19:48:36 user nova-compute[82196]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 11 19:48:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:51 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:48:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:53 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:48:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:54 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:48:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:58 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:48:59 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:48:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:48:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:48:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:48:59 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:48:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:48:59 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updating instance_info_cache with network_info: [{"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:48:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-f633037d-87d0-4dda-aa33-3cc9c3191080" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:48:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:49:00 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:49:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:49:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:49:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:49:00 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:49:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:00 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:49:01 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:49:01 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:49:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8546MB free_disk=26.25057601928711GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance f633037d-87d0-4dda-aa33-3cc9c3191080 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:49:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:49:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:49:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:49:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:49:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:49:08 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:49:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:49:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:49:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:49:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:49:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:49:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:49:36 user nova-compute[82196]: INFO nova.compute.manager [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Terminating instance
Apr 11 19:49:36 user nova-compute[82196]: DEBUG nova.compute.manager [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-4d97b442-3224-4114-b71c-9b5f0bb82819 req-95c857c5-d515-4a5a-a3fe-3acb6c102115 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received event network-vif-unplugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4d97b442-3224-4114-b71c-9b5f0bb82819 req-95c857c5-d515-4a5a-a3fe-3acb6c102115 service nova] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4d97b442-3224-4114-b71c-9b5f0bb82819 req-95c857c5-d515-4a5a-a3fe-3acb6c102115 service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4d97b442-3224-4114-b71c-9b5f0bb82819 req-95c857c5-d515-4a5a-a3fe-3acb6c102115 service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-4d97b442-3224-4114-b71c-9b5f0bb82819 req-95c857c5-d515-4a5a-a3fe-3acb6c102115 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] No waiting events found dispatching network-vif-unplugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG nova.compute.manager [req-4d97b442-3224-4114-b71c-9b5f0bb82819 req-95c857c5-d515-4a5a-a3fe-3acb6c102115 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received event network-vif-unplugged-c3ef7018-189c-423e-b92b-b2b4a98dafce for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:36 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:37 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Instance destroyed successfully.
Apr 11 19:49:37 user nova-compute[82196]: DEBUG nova.objects.instance [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'resources' on Instance uuid f633037d-87d0-4dda-aa33-3cc9c3191080 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2146974288',display_name='tempest-ServerActionsTestJSON-server-2146974288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2146974288',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:45:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-2nw0xxm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=f633037d-87d0-4dda-aa33-3cc9c3191080,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "address": "fa:16:3e:38:36:1c", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ef7018-18", "ovs_interfaceid": "c3ef7018-189c-423e-b92b-b2b4a98dafce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_vif [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3ef7018-18, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:49:37 user nova-compute[82196]: INFO os_vif [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:36:1c,bridge_name='br-int',has_traffic_filtering=True,id=c3ef7018-189c-423e-b92b-b2b4a98dafce,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ef7018-18')
Apr 11 19:49:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipgYEafu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:49:37 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9342b13-561a-4100-9d3e-2772fdc4209c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:49:37 user nova-compute[82196]: No targets found.
Apr 11 19:49:37 user nova-compute[82196]: iSNS:
Apr 11 19:49:37 user nova-compute[82196]: No targets found.
Apr 11 19:49:37 user nova-compute[82196]: STATIC:
Apr 11 19:49:37 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d
Apr 11 19:49:37 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:49:37 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:49:37 user nova-compute[82196]: FIRMWARE:
Apr 11 19:49:37 user nova-compute[82196]: No targets found.
Apr 11 19:49:37 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:49:37 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:49:37 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7be089-dbfd-4933-897d-e0fa41d8ccb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab0db8e-37cf-4945-9e58-40ca047175d6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:49:37 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d (non-flash)
Apr 11 19:49:37 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92741824d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d'): ({'sdb'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Removing single pathed devices sdb {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a6afd1-4e62-458f-a2f7-1e81e251f7b1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9c8de7-6e6f-4809-830a-349dc346b606]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Flushing IO for device /dev/sdb {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75f6bec-a050-43d1-87e8-aba95a2b45d0]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[802413ee-c2f0-42f5-959f-fd2e02b280f9]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO77f335f-ef6e95002e6d5a45', '/dev/disk/by-id/scsi-26566366539353030', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_77f335f') {{(pid=91954) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 19:49:37 user nova-compute[82196]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO77f335f-ef6e95002e6d5a45
Apr 11 19:49:37 user nova-compute[82196]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26566366539353030
Apr 11 19:49:37 user nova-compute[82196]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_77f335f
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ee4fc6-52c4-4018-b156-625a4fd45240]: (4, None) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[529d8bbc-0a7c-4672-85a0-7353bf33c1df]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d8c76f-4442-4559-9271-c7d6598f139e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260]
Apr 11 19:49:37 user nova-compute[82196]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d, portal: 172.16.0.220,3260] successful.
Apr 11 19:49:37 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc8ee09-43bc-4887-ad61-c9f10b5f487d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5656fc-ca69-4d1d-86a2-c68c4994e8a8]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] <== disconnect_volume: return (323ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:49:37 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Deleting instance files /opt/stack/data/nova/instances/f633037d-87d0-4dda-aa33-3cc9c3191080_del
Apr 11 19:49:37 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Deletion of /opt/stack/data/nova/instances/f633037d-87d0-4dda-aa33-3cc9c3191080_del complete
Apr 11 19:49:37 user nova-compute[82196]: INFO nova.compute.manager [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 11 19:49:37 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:49:37 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:49:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:38 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:49:38 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Took 0.83 seconds to deallocate network for instance.
Apr 11 19:49:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-211f0597-a450-4af5-8bb4-636a3778f8e0 req-f53f8653-e53e-4721-ae70-6e22038008c5 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received event network-vif-deleted-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:49:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-153b3112-0fe1-4867-a953-850ea785c603 req-b499347f-2dab-469a-9fe5-0dd95c3a7d96 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received event network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:49:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-153b3112-0fe1-4867-a953-850ea785c603 req-b499347f-2dab-469a-9fe5-0dd95c3a7d96 service nova] Acquiring lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:49:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-153b3112-0fe1-4867-a953-850ea785c603 req-b499347f-2dab-469a-9fe5-0dd95c3a7d96 service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:49:38 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-153b3112-0fe1-4867-a953-850ea785c603 req-b499347f-2dab-469a-9fe5-0dd95c3a7d96 service nova] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:49:38 user nova-compute[82196]: DEBUG nova.compute.manager [req-153b3112-0fe1-4867-a953-850ea785c603 req-b499347f-2dab-469a-9fe5-0dd95c3a7d96 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] No waiting events found dispatching network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:49:38 user nova-compute[82196]: WARNING nova.compute.manager [req-153b3112-0fe1-4867-a953-850ea785c603 req-b499347f-2dab-469a-9fe5-0dd95c3a7d96 service nova] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Received unexpected event network-vif-plugged-c3ef7018-189c-423e-b92b-b2b4a98dafce for instance with vm_state active and task_state deleting.
Apr 11 19:49:39 user nova-compute[82196]: INFO nova.compute.manager [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Took 0.91 seconds to detach 1 volumes for instance.
Apr 11 19:49:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Deleting volume: 8cc8ee09-43bc-4887-ad61-c9f10b5f487d {{(pid=82196) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 19:49:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:49:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:49:39 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:49:39 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:49:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:49:39 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Deleted allocations for instance f633037d-87d0-4dda-aa33-3cc9c3191080
Apr 11 19:49:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-91ef5f4a-3992-4381-9d0c-638e047474a3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "f633037d-87d0-4dda-aa33-3cc9c3191080" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.291s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:49:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:49:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:49:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:49:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:49:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:49:43 user nova-compute[82196]: INFO nova.compute.manager [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Terminating instance
Apr 11 19:49:43 user nova-compute[82196]: DEBUG nova.compute.manager [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:49:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-38983e0b-4056-4252-a7de-a8b02bc9f859 req-1f2b2984-78e7-4926-bfee-7e0872045ac6 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Received event network-vif-unplugged-91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:49:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-38983e0b-4056-4252-a7de-a8b02bc9f859 req-1f2b2984-78e7-4926-bfee-7e0872045ac6 service nova] Acquiring lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:49:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-38983e0b-4056-4252-a7de-a8b02bc9f859 req-1f2b2984-78e7-4926-bfee-7e0872045ac6 service nova] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:49:43 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-38983e0b-4056-4252-a7de-a8b02bc9f859 req-1f2b2984-78e7-4926-bfee-7e0872045ac6 service nova] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:49:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-38983e0b-4056-4252-a7de-a8b02bc9f859 req-1f2b2984-78e7-4926-bfee-7e0872045ac6 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] No waiting events found dispatching network-vif-unplugged-91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:49:43 user nova-compute[82196]: DEBUG nova.compute.manager [req-38983e0b-4056-4252-a7de-a8b02bc9f859 req-1f2b2984-78e7-4926-bfee-7e0872045ac6 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Received event network-vif-unplugged-91ae7fad-1a68-4881-8048-4fab8fcfe90a for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:49:44 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Instance destroyed successfully.
Apr 11 19:49:44 user nova-compute[82196]: DEBUG nova.objects.instance [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lazy-loading 'resources' on Instance uuid e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:47:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-467460675',display_name='tempest-VolumesActionsTest-instance-467460675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-467460675',id=45,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:47:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56b09d8c9ff94045a36fdc454f8875e8',ramdisk_id='',reservation_id='r-04b7tgh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-283035711',owner_user_name='tempest-VolumesActionsTest-283035711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:47:56Z,user_data=None,user_id='98feebb43745423299d602c50d09d982',uuid=e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "address": "fa:16:3e:e4:ed:7c", "network": {"id": "50e7af77-f722-402c-963f-0bfb77a025f7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1745886981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "56b09d8c9ff94045a36fdc454f8875e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ae7fad-1a", "ovs_interfaceid": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Converting VIF {"id": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "address": "fa:16:3e:e4:ed:7c", "network": {"id": "50e7af77-f722-402c-963f-0bfb77a025f7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1745886981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "56b09d8c9ff94045a36fdc454f8875e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ae7fad-1a", "ovs_interfaceid": "91ae7fad-1a68-4881-8048-4fab8fcfe90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ed:7c,bridge_name='br-int',has_traffic_filtering=True,id=91ae7fad-1a68-4881-8048-4fab8fcfe90a,network=Network(50e7af77-f722-402c-963f-0bfb77a025f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ae7fad-1a') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG os_vif [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ed:7c,bridge_name='br-int',has_traffic_filtering=True,id=91ae7fad-1a68-4881-8048-4fab8fcfe90a,network=Network(50e7af77-f722-402c-963f-0bfb77a025f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ae7fad-1a') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91ae7fad-1a, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:49:44 user nova-compute[82196]: INFO os_vif [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ed:7c,bridge_name='br-int',has_traffic_filtering=True,id=91ae7fad-1a68-4881-8048-4fab8fcfe90a,network=Network(50e7af77-f722-402c-963f-0bfb77a025f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ae7fad-1a')
Apr 11 19:49:44 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Deleting instance files /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04_del
Apr 11 19:49:44 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Deletion of /opt/stack/data/nova/instances/e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04_del complete
Apr 11 19:49:44 user nova-compute[82196]: INFO nova.compute.manager [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 11 19:49:44 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:49:44 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Took 0.45 seconds to deallocate network for instance.
Apr 11 19:49:44 user nova-compute[82196]: DEBUG nova.compute.manager [req-83c99ab6-959b-4b45-9759-241f61892de7 req-54a9151a-1fd1-4edd-b84f-4ff9d46bd0e3 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Received event network-vif-deleted-91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:49:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:49:44 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Deleted allocations for instance e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04
Apr 11 19:49:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-9161d225-6d73-4c52-ad26-c1d30037428d tempest-VolumesActionsTest-283035711 tempest-VolumesActionsTest-283035711-project-member] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.429s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:49:45 user nova-compute[82196]: DEBUG nova.compute.manager [req-14fbbcd1-8d6d-477a-8451-29556d8e8cb4 req-2c3d6fe7-e8e8-4d95-9c6e-9603d3caabb5 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Received event network-vif-plugged-91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:49:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-14fbbcd1-8d6d-477a-8451-29556d8e8cb4 req-2c3d6fe7-e8e8-4d95-9c6e-9603d3caabb5 service nova] Acquiring lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:49:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-14fbbcd1-8d6d-477a-8451-29556d8e8cb4 req-2c3d6fe7-e8e8-4d95-9c6e-9603d3caabb5 service nova] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:49:45 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-14fbbcd1-8d6d-477a-8451-29556d8e8cb4 req-2c3d6fe7-e8e8-4d95-9c6e-9603d3caabb5 service nova] Lock "e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:49:45 user nova-compute[82196]: DEBUG nova.compute.manager [req-14fbbcd1-8d6d-477a-8451-29556d8e8cb4 req-2c3d6fe7-e8e8-4d95-9c6e-9603d3caabb5 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] No waiting events found dispatching network-vif-plugged-91ae7fad-1a68-4881-8048-4fab8fcfe90a {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:49:45 user nova-compute[82196]: WARNING nova.compute.manager [req-14fbbcd1-8d6d-477a-8451-29556d8e8cb4 req-2c3d6fe7-e8e8-4d95-9c6e-9603d3caabb5 service nova] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Received unexpected event network-vif-plugged-91ae7fad-1a68-4881-8048-4fab8fcfe90a for instance with vm_state deleted and task_state None.
Apr 11 19:49:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:52 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242577.2422452, f633037d-87d0-4dda-aa33-3cc9c3191080 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:49:52 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] VM Stopped (Lifecycle Event)
Apr 11 19:49:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f6b4ff2b-49ef-4ed7-bd95-bf5d84ce4f62 None None] [instance: f633037d-87d0-4dda-aa33-3cc9c3191080] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:49:52 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:49:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:49:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:49:56 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:49:59 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242584.0006075, e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:49:59 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] VM Stopped (Lifecycle Event)
Apr 11 19:49:59 user nova-compute[82196]: DEBUG nova.compute.manager [None req-f499106b-9461-470a-85ce-335533301f36 None None] [instance: e5a20eb7-20f0-4adc-bd8c-b9bf25c46c04] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:49:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:49:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:49:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:49:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:49:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:49:59 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:50:01 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:50:01 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:50:01 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Didn't find any instances for network info cache update. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 19:50:01 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:50:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:50:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:50:01 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:50:01 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:50:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:50:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:50:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:50:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:50:02 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:50:02 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:50:02 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=26.267925262451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:50:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:50:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:50:02 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:50:02 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:50:02 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:50:02 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:50:02 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:50:02 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:50:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:50:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:50:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:50:03 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:50:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:50:09 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:50:10 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:50:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:50:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:50:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:50:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:50:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:50:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:50:27 user nova-compute[82196]: INFO nova.compute.manager [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Terminating instance
Apr 11 19:50:27 user nova-compute[82196]: DEBUG nova.compute.manager [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG nova.compute.manager [req-2f5a68d9-46b5-4e64-bc13-de048bcd4ca2 req-6b7b621f-308f-497b-bc14-5fe2c2147915 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Received event network-vif-unplugged-91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2f5a68d9-46b5-4e64-bc13-de048bcd4ca2 req-6b7b621f-308f-497b-bc14-5fe2c2147915 service nova] Acquiring lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2f5a68d9-46b5-4e64-bc13-de048bcd4ca2 req-6b7b621f-308f-497b-bc14-5fe2c2147915 service nova] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2f5a68d9-46b5-4e64-bc13-de048bcd4ca2 req-6b7b621f-308f-497b-bc14-5fe2c2147915 service nova] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG nova.compute.manager [req-2f5a68d9-46b5-4e64-bc13-de048bcd4ca2 req-6b7b621f-308f-497b-bc14-5fe2c2147915 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] No waiting events found dispatching network-vif-unplugged-91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG nova.compute.manager [req-2f5a68d9-46b5-4e64-bc13-de048bcd4ca2 req-6b7b621f-308f-497b-bc14-5fe2c2147915 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Received event network-vif-unplugged-91ef79db-4548-423d-9022-b88dd7608438 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:50:27 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Instance destroyed successfully.
Apr 11 19:50:27 user nova-compute[82196]: DEBUG nova.objects.instance [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lazy-loading 'resources' on Instance uuid 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1690661928',display_name='tempest-ServerActionsTestJSON-server-1690661928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1690661928',id=40,image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyHpdARVwQsB0yVIUDdRt39e/Rh8hpY6VgP/C5N1uvYaZZfTyXtGDRzpm2X2Az8MVhwAqoFSVzr+Ae6fw8QfbgkHfeed/GzNN9a27F9JKH0I8cWqQv/D93kLn/L5pokw==',key_name='tempest-keypair-185807874',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:41:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60a7381a31b84e97a068528f90813773',ramdisk_id='',reservation_id='r-z5t0whzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a0dd6f7-9ec9-4232-9d7e-dd0ddeabb76b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-37730514',owner_user_name='tempest-ServerActionsTestJSON-37730514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:41:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05fb551c320a48f98a4ec00a7f7492d7',uuid=478eb884-ba19-4a4b-b1eb-a2e59d6beef0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converting VIF {"id": "91ef79db-4548-423d-9022-b88dd7608438", "address": "fa:16:3e:0d:f0:20", "network": {"id": "8694f053-fd47-47b5-8463-d21b35fbe7ac", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1769183343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a7381a31b84e97a068528f90813773", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91ef79db-45", "ovs_interfaceid": "91ef79db-4548-423d-9022-b88dd7608438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=91ef79db-4548-423d-9022-b88dd7608438,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ef79db-45') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG os_vif [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=91ef79db-4548-423d-9022-b88dd7608438,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ef79db-45') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91ef79db-45, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:50:27 user nova-compute[82196]: INFO os_vif [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=91ef79db-4548-423d-9022-b88dd7608438,network=Network(8694f053-fd47-47b5-8463-d21b35fbe7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91ef79db-45')
Apr 11 19:50:27 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Deleting instance files /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0_del
Apr 11 19:50:27 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Deletion of /opt/stack/data/nova/instances/478eb884-ba19-4a4b-b1eb-a2e59d6beef0_del complete
Apr 11 19:50:27 user nova-compute[82196]: INFO nova.compute.manager [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Took 0.82 seconds to destroy the instance on the hypervisor.
Apr 11 19:50:27 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:50:27 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:50:28 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:50:28 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Took 0.77 seconds to deallocate network for instance.
Apr 11 19:50:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:50:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:50:28 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:50:28 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:50:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:50:28 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Deleted allocations for instance 478eb884-ba19-4a4b-b1eb-a2e59d6beef0
Apr 11 19:50:28 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-6880d8a6-d4ef-41ae-a9b4-36f1f48821c3 tempest-ServerActionsTestJSON-37730514 tempest-ServerActionsTestJSON-37730514-project-member] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.870s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:50:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Received event network-vif-plugged-91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:50:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] Acquiring lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:50:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:50:29 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] Lock "478eb884-ba19-4a4b-b1eb-a2e59d6beef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:50:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] No waiting events found dispatching network-vif-plugged-91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:50:29 user nova-compute[82196]: WARNING nova.compute.manager [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Received unexpected event network-vif-plugged-91ef79db-4548-423d-9022-b88dd7608438 for instance with vm_state deleted and task_state None.
Apr 11 19:50:29 user nova-compute[82196]: DEBUG nova.compute.manager [req-d36298f0-09e1-4697-bf5b-04b48f9341ae req-97d71c5a-aa26-4923-a3a0-636df5af1076 service nova] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Received event network-vif-deleted-91ef79db-4548-423d-9022-b88dd7608438 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:50:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:50:42 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242627.8044374, 478eb884-ba19-4a4b-b1eb-a2e59d6beef0 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:50:42 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] VM Stopped (Lifecycle Event)
Apr 11 19:50:42 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1c9dd237-c38d-4bf4-a3ce-d8b8f23ea185 None None] [instance: 478eb884-ba19-4a4b-b1eb-a2e59d6beef0] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:50:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:50:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:50:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:50:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:50:42 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:47 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:53 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:50:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:50:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:56 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:50:57 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:50:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:01 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:51:02 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:51:02 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:51:02 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=26.277233123779297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:51:02 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:51:03 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:51:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:51:04 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:51:04 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:51:04 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:51:04 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Didn't find any instances for network info cache update. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 19:51:04 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:51:04 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:51:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:07 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:51:08 user nova-compute[82196]: INFO nova.compute.claims [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Claim successful on node user
Apr 11 19:51:08 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:51:08 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:51:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG nova.policy [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:51:08 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Creating image(s)
Apr 11 19:51:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "/opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "/opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "/opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "03f5748f4fa280a4eb90eabd56922b871c5ae6ee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:51:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "03f5748f4fa280a4eb90eabd56922b871c5ae6ee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee.part --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee.part --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG nova.virt.images [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] bf3454f9-a827-4dc1-a960-dc67109c289a was qcow2, converting to raw {{(pid=82196) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee.part /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee.converted {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Successfully created port: 32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee.part /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee.converted" returned: 0 in 0.269s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee.converted --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee.converted --force-share --output=json" returned: 0 in 0.137s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "03f5748f4fa280a4eb90eabd56922b871c5ae6ee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.982s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "03f5748f4fa280a4eb90eabd56922b871c5ae6ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "03f5748f4fa280a4eb90eabd56922b871c5ae6ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:51:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee,backing_fmt=raw /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee,backing_fmt=raw /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk 1073741824" returned: 0 in 0.054s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "03f5748f4fa280a4eb90eabd56922b871c5ae6ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Successfully updated port: 32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-changed-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Refreshing instance network info cache due to event network-changed-32c90c1c-3212-4427-a38d-f505443bf260. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] Acquiring lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] Acquired lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Refreshing network info cache for port 32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee --force-share --output=json" returned: 0 in 0.131s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Cannot resize image /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'migration_context' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Ensure instance console log exists: /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b7dd3127-4cd1-44df-9899-40d7c2e0658b req-7b354b2f-7736-4bbc-9fed-81e1cc27252d service nova] Releasing lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquired lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating instance_info_cache with network_info: [{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Releasing lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Instance network_info: |[{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Start _get_guest_xml network_info=[{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:51:06Z,direct_url=<?>,disk_format='qcow2',id=bf3454f9-a827-4dc1-a960-dc67109c289a,min_disk=0,min_ram=0,name='tempest-scenario-img--2047440314',owner='ae5919e23c6a4c54b3a05a422c232c9f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:51:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'bf3454f9-a827-4dc1-a960-dc67109c289a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:51:10 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:51:10 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:51:06Z,direct_url=<?>,disk_format='qcow2',id=bf3454f9-a827-4dc1-a960-dc67109c289a,min_disk=0,min_ram=0,name='tempest-scenario-img--2047440314',owner='ae5919e23c6a4c54b3a05a422c232c9f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:51:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1892471232',display_name='tempest-TestMinimumBasicScenario-server-1892471232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1892471232',id=46,image_ref='bf3454f9-a827-4dc1-a960-dc67109c289a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI18204baiBVey1ZMWNZgAXku8ITr+T9lmJFBe0OUSjsJjhwMsoF8Nia2sCNNHRfU+aQv/nMbkic9XzbeqSSkUeyn6yJaTTLyXjcGyr2kpsbZzhhonDPPZJaRnKWHYbpug==',key_name='tempest-TestMinimumBasicScenario-1152467569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae5919e23c6a4c54b3a05a422c232c9f',ramdisk_id='',reservation_id='r-qqe0gs99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf3454f9-a827-4dc1-a960-dc67109c289a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1332908423',owner_user_name='tempest-TestMinimumBasicScenario-1332908423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:51:09Z,user_data=None,user_id='2fbfa8948ce64dff92344749d2f0f0c7',uuid=52298792-b22d-4c8e-ba29-babc5653e2cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converting VIF {"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.objects.instance [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'pci_devices' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:51:10 user nova-compute[82196]:   <uuid>52298792-b22d-4c8e-ba29-babc5653e2cc</uuid>
Apr 11 19:51:10 user nova-compute[82196]:   <name>instance-0000002e</name>
Apr 11 19:51:10 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:51:10 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:51:10 user nova-compute[82196]:   <metadata>
Apr 11 19:51:10 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:51:10 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:51:10 user nova-compute[82196]:       <nova:name>tempest-TestMinimumBasicScenario-server-1892471232</nova:name>
Apr 11 19:51:10 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:51:10</nova:creationTime>
Apr 11 19:51:10 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:51:10 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:51:10 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:51:10 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:51:10 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:51:10 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:51:10 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:51:10 user nova-compute[82196]:       <nova:owner>
Apr 11 19:51:10 user nova-compute[82196]:         <nova:user uuid="2fbfa8948ce64dff92344749d2f0f0c7">tempest-TestMinimumBasicScenario-1332908423-project-member</nova:user>
Apr 11 19:51:10 user nova-compute[82196]:         <nova:project uuid="ae5919e23c6a4c54b3a05a422c232c9f">tempest-TestMinimumBasicScenario-1332908423</nova:project>
Apr 11 19:51:10 user nova-compute[82196]:       </nova:owner>
Apr 11 19:51:10 user nova-compute[82196]:       <nova:root type="image" uuid="bf3454f9-a827-4dc1-a960-dc67109c289a"/>
Apr 11 19:51:10 user nova-compute[82196]:       <nova:ports>
Apr 11 19:51:10 user nova-compute[82196]:         <nova:port uuid="32c90c1c-3212-4427-a38d-f505443bf260">
Apr 11 19:51:10 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:51:10 user nova-compute[82196]:         </nova:port>
Apr 11 19:51:10 user nova-compute[82196]:       </nova:ports>
Apr 11 19:51:10 user nova-compute[82196]:     </nova:instance>
Apr 11 19:51:10 user nova-compute[82196]:   </metadata>
Apr 11 19:51:10 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:51:10 user nova-compute[82196]:     <system>
Apr 11 19:51:10 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:51:10 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:51:10 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:51:10 user nova-compute[82196]:       <entry name="serial">52298792-b22d-4c8e-ba29-babc5653e2cc</entry>
Apr 11 19:51:10 user nova-compute[82196]:       <entry name="uuid">52298792-b22d-4c8e-ba29-babc5653e2cc</entry>
Apr 11 19:51:10 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:51:10 user nova-compute[82196]:     </system>
Apr 11 19:51:10 user nova-compute[82196]:   </sysinfo>
Apr 11 19:51:10 user nova-compute[82196]:   <os>
Apr 11 19:51:10 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:51:10 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:51:10 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:51:10 user nova-compute[82196]:   </os>
Apr 11 19:51:10 user nova-compute[82196]:   <features>
Apr 11 19:51:10 user nova-compute[82196]:     <acpi/>
Apr 11 19:51:10 user nova-compute[82196]:     <apic/>
Apr 11 19:51:10 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:51:10 user nova-compute[82196]:   </features>
Apr 11 19:51:10 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:51:10 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:51:10 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:51:10 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:51:10 user nova-compute[82196]:   </clock>
Apr 11 19:51:10 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:51:10 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:51:10 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:51:10 user nova-compute[82196]:   </cpu>
Apr 11 19:51:10 user nova-compute[82196]:   <devices>
Apr 11 19:51:10 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:51:10 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:51:10 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk"/>
Apr 11 19:51:10 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:51:10 user nova-compute[82196]:     </disk>
Apr 11 19:51:10 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:51:10 user nova-compute[82196]:       <mac address="fa:16:3e:a5:10:b4"/>
Apr 11 19:51:10 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:51:10 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:51:10 user nova-compute[82196]:       <target dev="tap32c90c1c-32"/>
Apr 11 19:51:10 user nova-compute[82196]:     </interface>
Apr 11 19:51:10 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:51:10 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/console.log" append="off"/>
Apr 11 19:51:10 user nova-compute[82196]:     </serial>
Apr 11 19:51:10 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:51:10 user nova-compute[82196]:     <video>
Apr 11 19:51:10 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:51:10 user nova-compute[82196]:     </video>
Apr 11 19:51:10 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:51:10 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:51:10 user nova-compute[82196]:     </rng>
Apr 11 19:51:10 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:51:10 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:51:10 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:51:10 user nova-compute[82196]:     </memballoon>
Apr 11 19:51:10 user nova-compute[82196]:   </devices>
Apr 11 19:51:10 user nova-compute[82196]: </domain>
Apr 11 19:51:10 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1892471232',display_name='tempest-TestMinimumBasicScenario-server-1892471232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1892471232',id=46,image_ref='bf3454f9-a827-4dc1-a960-dc67109c289a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI18204baiBVey1ZMWNZgAXku8ITr+T9lmJFBe0OUSjsJjhwMsoF8Nia2sCNNHRfU+aQv/nMbkic9XzbeqSSkUeyn6yJaTTLyXjcGyr2kpsbZzhhonDPPZJaRnKWHYbpug==',key_name='tempest-TestMinimumBasicScenario-1152467569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae5919e23c6a4c54b3a05a422c232c9f',ramdisk_id='',reservation_id='r-qqe0gs99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf3454f9-a827-4dc1-a960-dc67109c289a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1332908423',owner_user_name='tempest-TestMinimumBasicScenario-1332908423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:51:09Z,user_data=None,user_id='2fbfa8948ce64dff92344749d2f0f0c7',uuid=52298792-b22d-4c8e-ba29-babc5653e2cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converting VIF {"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG os_vif [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32c90c1c-32, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32c90c1c-32, col_values=(('external_ids', {'iface-id': '32c90c1c-3212-4427-a38d-f505443bf260', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:10:b4', 'vm-uuid': '52298792-b22d-4c8e-ba29-babc5653e2cc'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:10 user nova-compute[82196]: INFO os_vif [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32')
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:51:10 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] No VIF found with MAC fa:16:3e:a5:10:b4, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:51:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-3d995229-377a-46cd-98af-664d6b2b6807 req-a76b5764-6c2b-47b1-a655-0bfa41d3ebe5 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:51:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3d995229-377a-46cd-98af-664d6b2b6807 req-a76b5764-6c2b-47b1-a655-0bfa41d3ebe5 service nova] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:51:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3d995229-377a-46cd-98af-664d6b2b6807 req-a76b5764-6c2b-47b1-a655-0bfa41d3ebe5 service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:51:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3d995229-377a-46cd-98af-664d6b2b6807 req-a76b5764-6c2b-47b1-a655-0bfa41d3ebe5 service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:51:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-3d995229-377a-46cd-98af-664d6b2b6807 req-a76b5764-6c2b-47b1-a655-0bfa41d3ebe5 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] No waiting events found dispatching network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:51:12 user nova-compute[82196]: WARNING nova.compute.manager [req-3d995229-377a-46cd-98af-664d6b2b6807 req-a76b5764-6c2b-47b1-a655-0bfa41d3ebe5 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received unexpected event network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 for instance with vm_state building and task_state spawning.
Apr 11 19:51:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:12 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242674.3785317, 52298792-b22d-4c8e-ba29-babc5653e2cc => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:51:14 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] VM Resumed (Lifecycle Event)
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:51:14 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Instance spawned successfully.
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:51:14 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242674.3800595, 52298792-b22d-4c8e-ba29-babc5653e2cc => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:51:14 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] VM Started (Lifecycle Event)
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:51:14 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:51:14 user nova-compute[82196]: INFO nova.compute.manager [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Took 5.65 seconds to spawn the instance on the hypervisor.
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:51:14 user nova-compute[82196]: INFO nova.compute.manager [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Took 6.15 seconds to build instance.
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-bb3fbeef-f1e8-4a56-b617-83938da9afd6 req-b38340d6-9089-4cc7-8686-dc7eb68d95de service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bb3fbeef-f1e8-4a56-b617-83938da9afd6 req-b38340d6-9089-4cc7-8686-dc7eb68d95de service nova] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bb3fbeef-f1e8-4a56-b617-83938da9afd6 req-b38340d6-9089-4cc7-8686-dc7eb68d95de service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-bb3fbeef-f1e8-4a56-b617-83938da9afd6 req-b38340d6-9089-4cc7-8686-dc7eb68d95de service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:51:14 user nova-compute[82196]: DEBUG nova.compute.manager [req-bb3fbeef-f1e8-4a56-b617-83938da9afd6 req-b38340d6-9089-4cc7-8686-dc7eb68d95de service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] No waiting events found dispatching network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:51:14 user nova-compute[82196]: WARNING nova.compute.manager [req-bb3fbeef-f1e8-4a56-b617-83938da9afd6 req-b38340d6-9089-4cc7-8686-dc7eb68d95de service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received unexpected event network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 for instance with vm_state active and task_state None.
Apr 11 19:51:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-1518ab9e-3de6-42ad-a638-204233c33741 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.257s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:51:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:51:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:51:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:51:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:51:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:51:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:51:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:51:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:51:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:52 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:53 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:51:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:51:56 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:51:58 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:52:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:52:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:52:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:52:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:52:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:52:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:52:03 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:52:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:52:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:52:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:52:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:52:04 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:52:04 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:52:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8688MB free_disk=26.20677947998047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:52:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:52:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:52:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 52298792-b22d-4c8e-ba29-babc5653e2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:52:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:52:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:52:04 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:52:04 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:52:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:52:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:06 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating instance_info_cache with network_info: [{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:52:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:52:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:52:06 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:52:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:52:10 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:52:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:12 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:52:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:52:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:52:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:52:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:52:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:52:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:52:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:52:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:52:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:52:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:52:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:52:56 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:52:57 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:52:58 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:53:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:53:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:53:00 user nova-compute[82196]: DEBUG nova.objects.instance [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'flavor' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:53:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:53:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:53:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:53:00 user nova-compute[82196]: INFO nova.compute.manager [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Attaching volume 54b75fb4-6f33-4acd-b9e2-4759c27ac582 to /dev/vdb
Apr 11 19:53:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG os_brick.utils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c047b39-1911-4235-8b56-29aafcd2b3ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6e21f8-3c8c-417a-9199-8f724a2f61f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85c7fbb-3b40-47e9-bbff-c65a27139df6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9510131-737f-47db-8d1a-93050a2fa4ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:53:01 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:53:01 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf152d2d-07d9-4a22-b5e5-c68fbbd472bf]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG os_brick.utils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:53:01 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating existing volume attachment record: 30931b88-4890-4873-b503-883248a8b35f {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:53:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:53:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:53:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:53:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:53:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:53:03 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:53:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:04 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:53:04 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:53:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=26.197952270507812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 52298792-b22d-4c8e-ba29-babc5653e2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing inventories for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Updating ProviderTree inventory for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Updating inventory in ProviderTree for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing aggregate associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, aggregates: None {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing trait associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:53:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPQvcHyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:53:05 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:53:05 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:53:05 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cba01d-9bb2-4046-9e04-3823d9fc7b4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:53:05 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[94306902-4374-42d6-9ff8-1362ab113944]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582] added
Apr 11 19:53:05 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f51fe1-6830-4753-9e16-f3e62f2b2987]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbf4a70-184e-442e-ada0-47678d2a83e8]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPQvcHyW {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPQvcHyW" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2835228d-124c-4519-9b13-a2f9b770975f]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uPQvcHyW'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0387e371-a33c-4233-8881-dff1a7fc8e3b]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db88fa0-7759-4d1f-9d52-f12a2a99cd30]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 19:53:05 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 19:53:05 user nova-compute[82196]:  {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:53:05 user nova-compute[82196]: WARNING os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 19:53:05 user nova-compute[82196]: 
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a7d0da-b335-41d7-9f37-02c3a869b316]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260]
Apr 11 19:53:05 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260] successful.
Apr 11 19:53:05 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e7044f-6dc8-4a9e-a558-6f995d01825c]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd24951-defa-4a4e-838b-860d690d4cf2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 (non-flash)
Apr 11 19:53:05 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 (non-flash)
Apr 11 19:53:05 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e58912-095a-404d-a084-d6d91bbb0c39]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPQvcHyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:53:05 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '26238396338663831', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238396338663831', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG nova.objects.instance [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'flavor' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:53:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:53:06 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:53:06 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:53:06 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:53:06 user nova-compute[82196]:   <serial>54b75fb4-6f33-4acd-b9e2-4759c27ac582</serial>
Apr 11 19:53:06 user nova-compute[82196]: </disk>
Apr 11 19:53:06 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:53:07 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating instance_info_cache with network_info: [{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:53:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:53:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:53:07 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:53:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:53:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:53:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:53:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] No VIF found with MAC fa:16:3e:a5:10:b4, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:53:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-0fbb1517-ba49-4340-b2c4-0d148f3626e1 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.241s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:53:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-changed-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:53:10 user nova-compute[82196]: DEBUG nova.compute.manager [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Refreshing instance network info cache due to event network-changed-32c90c1c-3212-4427-a38d-f505443bf260. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:53:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] Acquiring lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:53:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] Acquired lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:53:10 user nova-compute[82196]: DEBUG nova.network.neutron [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Refreshing network info cache for port 32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:53:11 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:11 user nova-compute[82196]: DEBUG nova.network.neutron [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updated VIF entry in instance network info cache for port 32c90c1c-3212-4427-a38d-f505443bf260. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:53:11 user nova-compute[82196]: DEBUG nova.network.neutron [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating instance_info_cache with network_info: [{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:53:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-62572ae7-3391-4627-9095-c4703c1f06ad req-c2b8a8a0-91c8-4162-a658-6c8b56f6398c service nova] Releasing lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:53:12 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:53:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-changed-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:53:12 user nova-compute[82196]: DEBUG nova.compute.manager [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Refreshing instance network info cache due to event network-changed-32c90c1c-3212-4427-a38d-f505443bf260. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:53:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] Acquiring lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:53:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] Acquired lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:53:12 user nova-compute[82196]: DEBUG nova.network.neutron [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Refreshing network info cache for port 32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:53:13 user nova-compute[82196]: DEBUG nova.network.neutron [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updated VIF entry in instance network info cache for port 32c90c1c-3212-4427-a38d-f505443bf260. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:53:13 user nova-compute[82196]: DEBUG nova.network.neutron [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating instance_info_cache with network_info: [{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:53:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7266e50f-8c5e-4cb9-b7a8-3eb8f7bfeaac req-514968d7-2b74-4fdf-ae08-cd9b37e6d9d8 service nova] Releasing lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:53:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:53:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:53:14 user nova-compute[82196]: INFO nova.compute.manager [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Rebooting instance
Apr 11 19:53:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:53:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquired lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:53:14 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:53:14 user nova-compute[82196]: DEBUG nova.network.neutron [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating instance_info_cache with network_info: [{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:53:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Releasing lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:53:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:53:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-73e7a7f8-36a9-4ab1-9b0c-00f854e9da6a req-c4bf6ab5-853d-446f-8c30-5571b88964bb service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-vif-unplugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-73e7a7f8-36a9-4ab1-9b0c-00f854e9da6a req-c4bf6ab5-853d-446f-8c30-5571b88964bb service nova] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-73e7a7f8-36a9-4ab1-9b0c-00f854e9da6a req-c4bf6ab5-853d-446f-8c30-5571b88964bb service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-73e7a7f8-36a9-4ab1-9b0c-00f854e9da6a req-c4bf6ab5-853d-446f-8c30-5571b88964bb service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG nova.compute.manager [req-73e7a7f8-36a9-4ab1-9b0c-00f854e9da6a req-c4bf6ab5-853d-446f-8c30-5571b88964bb service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] No waiting events found dispatching network-vif-unplugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:53:15 user nova-compute[82196]: WARNING nova.compute.manager [req-73e7a7f8-36a9-4ab1-9b0c-00f854e9da6a req-c4bf6ab5-853d-446f-8c30-5571b88964bb service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received unexpected event network-vif-unplugged-32c90c1c-3212-4427-a38d-f505443bf260 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 19:53:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:15 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Instance destroyed successfully.
Apr 11 19:53:15 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'resources' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1892471232',display_name='tempest-TestMinimumBasicScenario-server-1892471232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1892471232',id=46,image_ref='bf3454f9-a827-4dc1-a960-dc67109c289a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI18204baiBVey1ZMWNZgAXku8ITr+T9lmJFBe0OUSjsJjhwMsoF8Nia2sCNNHRfU+aQv/nMbkic9XzbeqSSkUeyn6yJaTTLyXjcGyr2kpsbZzhhonDPPZJaRnKWHYbpug==',key_name='tempest-TestMinimumBasicScenario-1152467569',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae5919e23c6a4c54b3a05a422c232c9f',ramdisk_id='',reservation_id='r-qqe0gs99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf3454f9-a827-4dc1-a960-dc67109c289a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1332908423',owner_user_name='tempest-TestMinimumBasicScenario-1332908423-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:53:15Z,user_data=None,user_id='2fbfa8948ce64dff92344749d2f0f0c7',uuid=52298792-b22d-4c8e-ba29-babc5653e2cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converting VIF {"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_vif [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32c90c1c-32, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:53:15 user nova-compute[82196]: INFO os_vif [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32')
Apr 11 19:53:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPQvcHyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:53:15 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09e065b-bb89-494f-a910-261073eb22b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:53:15 user nova-compute[82196]: No targets found.
Apr 11 19:53:15 user nova-compute[82196]: iSNS:
Apr 11 19:53:15 user nova-compute[82196]: No targets found.
Apr 11 19:53:15 user nova-compute[82196]: STATIC:
Apr 11 19:53:15 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582
Apr 11 19:53:15 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:53:15 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:53:15 user nova-compute[82196]: FIRMWARE:
Apr 11 19:53:15 user nova-compute[82196]: No targets found.
Apr 11 19:53:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:53:15 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:53:15 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a02af4-73b5-46b5-921c-9102d7aa1d63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5937847-5b07-48d5-a461-fda6b277bc3c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 (non-flash)
Apr 11 19:53:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 (non-flash)
Apr 11 19:53:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92741803a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582'): ({'sdb'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Removing single pathed devices sdb {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[952f6469-05d3-4d47-9ca6-22abcd985223]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f381a649-5fe1-401f-b08c-3dbd183fa9cc]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flushing IO for device /dev/sdb {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bbcd40-0dbd-4aed-973e-9be47b6bd43e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7087075e-5ec0-4f00-b930-455fd0871bf6]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00e9705-b5f3-4d31-ad7f-b322b4cbb908]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a701d9-9afa-4a75-aed8-9e54d31ffe6e]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260]
Apr 11 19:53:15 user nova-compute[82196]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260] successful.
Apr 11 19:53:15 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead1de28-3e6c-4120-a087-418057dab13e]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] <== disconnect_volume: return (278ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:53:15 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Start _get_guest_xml network_info=[{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf3454f9-a827-4dc1-a960-dc67109c289a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'bf3454f9-a827-4dc1-a960-dc67109c289a'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPQvcHyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '52298792-b22d-4c8e-ba29-babc5653e2cc', 'attached_at': '', 'detached_at': '', 'volume_id': '54b75fb4-6f33-4acd-b9e2-4759c27ac582', 'serial': '54b75fb4-6f33-4acd-b9e2-4759c27ac582'}, 'attachment_id': '30931b88-4890-4873-b503-883248a8b35f', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:53:16 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:53:16 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf3454f9-a827-4dc1-a960-dc67109c289a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'vcpu_model' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPQvcHyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:53:16 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:53:16 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:53:16 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[002113c5-8b33-4fef-960c-c2c411c7f194]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:53:16 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[243f4317-5f5a-4a24-a9f6-7a9106cf72c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582] added
Apr 11 19:53:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f0a217-fcf9-4aef-a060-ccfd9a91440d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0916213-3b7e-4a91-812d-c958c458cc59]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPQvcHyW {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPQvcHyW" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[7985640c-b329-4959-9023-ab1e24f14921]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uPQvcHyW'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c66f47e-24c8-4eb3-850e-57745e001b89]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba65b4e5-f959-4467-8493-909c09d88b0c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 19:53:16 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 19:53:16 user nova-compute[82196]:  {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:53:16 user nova-compute[82196]: WARNING os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 19:53:16 user nova-compute[82196]: 
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c1ab9b-a779-4237-9fc2-e9559c49bfe5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260]
Apr 11 19:53:16 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260] successful.
Apr 11 19:53:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea579d9-135c-4ed3-b46a-756b66967918]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d2109f-a4f6-4d40-af82-991bb006e6ca]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 (non-flash)
Apr 11 19:53:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 (non-flash)
Apr 11 19:53:16 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8a3570-3463-4fb1-8bae-b420a25dfdc2]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:53:16 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPQvcHyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-3b9a2390-ee6c-4386-8455-653955b5e117 req-8c3902c5-4793-49db-b128-a2bc5f5a63a2 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3b9a2390-ee6c-4386-8455-653955b5e117 req-8c3902c5-4793-49db-b128-a2bc5f5a63a2 service nova] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3b9a2390-ee6c-4386-8455-653955b5e117 req-8c3902c5-4793-49db-b128-a2bc5f5a63a2 service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3b9a2390-ee6c-4386-8455-653955b5e117 req-8c3902c5-4793-49db-b128-a2bc5f5a63a2 service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.compute.manager [req-3b9a2390-ee6c-4386-8455-653955b5e117 req-8c3902c5-4793-49db-b128-a2bc5f5a63a2 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] No waiting events found dispatching network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:53:17 user nova-compute[82196]: WARNING nova.compute.manager [req-3b9a2390-ee6c-4386-8455-653955b5e117 req-8c3902c5-4793-49db-b128-a2bc5f5a63a2 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received unexpected event network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 19:53:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.264s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] <== connect_volume: return (1265ms) {'type': 'block', 'scsi_wwn': '26238396338663831', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238396338663831', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1892471232',display_name='tempest-TestMinimumBasicScenario-server-1892471232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1892471232',id=46,image_ref='bf3454f9-a827-4dc1-a960-dc67109c289a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI18204baiBVey1ZMWNZgAXku8ITr+T9lmJFBe0OUSjsJjhwMsoF8Nia2sCNNHRfU+aQv/nMbkic9XzbeqSSkUeyn6yJaTTLyXjcGyr2kpsbZzhhonDPPZJaRnKWHYbpug==',key_name='tempest-TestMinimumBasicScenario-1152467569',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae5919e23c6a4c54b3a05a422c232c9f',ramdisk_id='',reservation_id='r-qqe0gs99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf3454f9-a827-4dc1-a960-dc67109c289a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1332908423',owner_user_name='tempest-TestMinimumBasicScenario-1332908423-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:53:15Z,user_data=None,user_id='2fbfa8948ce64dff92344749d2f0f0c7',uuid=52298792-b22d-4c8e-ba29-babc5653e2cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converting VIF {"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'pci_devices' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:53:17 user nova-compute[82196]:   <uuid>52298792-b22d-4c8e-ba29-babc5653e2cc</uuid>
Apr 11 19:53:17 user nova-compute[82196]:   <name>instance-0000002e</name>
Apr 11 19:53:17 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:53:17 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:53:17 user nova-compute[82196]:   <metadata>
Apr 11 19:53:17 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:53:17 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:53:17 user nova-compute[82196]:       <nova:name>tempest-TestMinimumBasicScenario-server-1892471232</nova:name>
Apr 11 19:53:17 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:53:16</nova:creationTime>
Apr 11 19:53:17 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:53:17 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:53:17 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:53:17 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:53:17 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:53:17 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:53:17 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:53:17 user nova-compute[82196]:       <nova:owner>
Apr 11 19:53:17 user nova-compute[82196]:         <nova:user uuid="2fbfa8948ce64dff92344749d2f0f0c7">tempest-TestMinimumBasicScenario-1332908423-project-member</nova:user>
Apr 11 19:53:17 user nova-compute[82196]:         <nova:project uuid="ae5919e23c6a4c54b3a05a422c232c9f">tempest-TestMinimumBasicScenario-1332908423</nova:project>
Apr 11 19:53:17 user nova-compute[82196]:       </nova:owner>
Apr 11 19:53:17 user nova-compute[82196]:       <nova:root type="image" uuid="bf3454f9-a827-4dc1-a960-dc67109c289a"/>
Apr 11 19:53:17 user nova-compute[82196]:       <nova:ports>
Apr 11 19:53:17 user nova-compute[82196]:         <nova:port uuid="32c90c1c-3212-4427-a38d-f505443bf260">
Apr 11 19:53:17 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 19:53:17 user nova-compute[82196]:         </nova:port>
Apr 11 19:53:17 user nova-compute[82196]:       </nova:ports>
Apr 11 19:53:17 user nova-compute[82196]:     </nova:instance>
Apr 11 19:53:17 user nova-compute[82196]:   </metadata>
Apr 11 19:53:17 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:53:17 user nova-compute[82196]:     <system>
Apr 11 19:53:17 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:53:17 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:53:17 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:53:17 user nova-compute[82196]:       <entry name="serial">52298792-b22d-4c8e-ba29-babc5653e2cc</entry>
Apr 11 19:53:17 user nova-compute[82196]:       <entry name="uuid">52298792-b22d-4c8e-ba29-babc5653e2cc</entry>
Apr 11 19:53:17 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:53:17 user nova-compute[82196]:     </system>
Apr 11 19:53:17 user nova-compute[82196]:   </sysinfo>
Apr 11 19:53:17 user nova-compute[82196]:   <os>
Apr 11 19:53:17 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:53:17 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:53:17 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:53:17 user nova-compute[82196]:   </os>
Apr 11 19:53:17 user nova-compute[82196]:   <features>
Apr 11 19:53:17 user nova-compute[82196]:     <acpi/>
Apr 11 19:53:17 user nova-compute[82196]:     <apic/>
Apr 11 19:53:17 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:53:17 user nova-compute[82196]:   </features>
Apr 11 19:53:17 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:53:17 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:53:17 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:53:17 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:53:17 user nova-compute[82196]:   </clock>
Apr 11 19:53:17 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:53:17 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:53:17 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:53:17 user nova-compute[82196]:   </cpu>
Apr 11 19:53:17 user nova-compute[82196]:   <devices>
Apr 11 19:53:17 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:53:17 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:53:17 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk"/>
Apr 11 19:53:17 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:53:17 user nova-compute[82196]:     </disk>
Apr 11 19:53:17 user nova-compute[82196]:     <disk type="block" device="disk">
Apr 11 19:53:17 user nova-compute[82196]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:53:17 user nova-compute[82196]:       <source dev="/dev/sdb"/>
Apr 11 19:53:17 user nova-compute[82196]:       <target dev="vdb" bus="virtio"/>
Apr 11 19:53:17 user nova-compute[82196]:       <serial>54b75fb4-6f33-4acd-b9e2-4759c27ac582</serial>
Apr 11 19:53:17 user nova-compute[82196]:     </disk>
Apr 11 19:53:17 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:53:17 user nova-compute[82196]:       <mac address="fa:16:3e:a5:10:b4"/>
Apr 11 19:53:17 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:53:17 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:53:17 user nova-compute[82196]:       <target dev="tap32c90c1c-32"/>
Apr 11 19:53:17 user nova-compute[82196]:     </interface>
Apr 11 19:53:17 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:53:17 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/console.log" append="off"/>
Apr 11 19:53:17 user nova-compute[82196]:     </serial>
Apr 11 19:53:17 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:53:17 user nova-compute[82196]:     <video>
Apr 11 19:53:17 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:53:17 user nova-compute[82196]:     </video>
Apr 11 19:53:17 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:53:17 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:53:17 user nova-compute[82196]:     </rng>
Apr 11 19:53:17 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:53:17 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:53:17 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:53:17 user nova-compute[82196]:     </memballoon>
Apr 11 19:53:17 user nova-compute[82196]:   </devices>
Apr 11 19:53:17 user nova-compute[82196]: </domain>
Apr 11 19:53:17 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'trusted_certs' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Cannot resize image /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'migration_context' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1892471232',display_name='tempest-TestMinimumBasicScenario-server-1892471232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1892471232',id=46,image_ref='bf3454f9-a827-4dc1-a960-dc67109c289a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI18204baiBVey1ZMWNZgAXku8ITr+T9lmJFBe0OUSjsJjhwMsoF8Nia2sCNNHRfU+aQv/nMbkic9XzbeqSSkUeyn6yJaTTLyXjcGyr2kpsbZzhhonDPPZJaRnKWHYbpug==',key_name='tempest-TestMinimumBasicScenario-1152467569',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ae5919e23c6a4c54b3a05a422c232c9f',ramdisk_id='',reservation_id='r-qqe0gs99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf3454f9-a827-4dc1-a960-dc67109c289a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1332908423',owner_user_name='tempest-TestMinimumBasicScenario-1332908423-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:53:15Z,user_data=None,user_id='2fbfa8948ce64dff92344749d2f0f0c7',uuid=52298792-b22d-4c8e-ba29-babc5653e2cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converting VIF {"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG os_vif [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32c90c1c-32, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32c90c1c-32, col_values=(('external_ids', {'iface-id': '32c90c1c-3212-4427-a38d-f505443bf260', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:10:b4', 'vm-uuid': '52298792-b22d-4c8e-ba29-babc5653e2cc'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:53:17 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:17 user nova-compute[82196]: INFO os_vif [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32')
Apr 11 19:53:18 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:53:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 19:53:18 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] There are 0 instances to clean {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 19:53:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:19 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:53:19 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82196) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 19:53:19 user nova-compute[82196]: DEBUG nova.compute.manager [req-8103a83c-f47f-473e-91b7-b5da6d4b7646 req-c5004bc9-ebd5-47d2-a36b-1eaeb9cff337 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:53:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8103a83c-f47f-473e-91b7-b5da6d4b7646 req-c5004bc9-ebd5-47d2-a36b-1eaeb9cff337 service nova] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:53:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8103a83c-f47f-473e-91b7-b5da6d4b7646 req-c5004bc9-ebd5-47d2-a36b-1eaeb9cff337 service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:53:19 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-8103a83c-f47f-473e-91b7-b5da6d4b7646 req-c5004bc9-ebd5-47d2-a36b-1eaeb9cff337 service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:53:19 user nova-compute[82196]: DEBUG nova.compute.manager [req-8103a83c-f47f-473e-91b7-b5da6d4b7646 req-c5004bc9-ebd5-47d2-a36b-1eaeb9cff337 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] No waiting events found dispatching network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:53:19 user nova-compute[82196]: WARNING nova.compute.manager [req-8103a83c-f47f-473e-91b7-b5da6d4b7646 req-c5004bc9-ebd5-47d2-a36b-1eaeb9cff337 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received unexpected event network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 19:53:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:21 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for 52298792-b22d-4c8e-ba29-babc5653e2cc due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:53:21 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242801.348452, 52298792-b22d-4c8e-ba29-babc5653e2cc => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:53:21 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] VM Resumed (Lifecycle Event)
Apr 11 19:53:21 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:53:21 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Instance rebooted successfully.
Apr 11 19:53:21 user nova-compute[82196]: DEBUG nova.compute.manager [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:53:21 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:53:21 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:53:21 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 11 19:53:21 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681242801.352356, 52298792-b22d-4c8e-ba29-babc5653e2cc => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:53:21 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] VM Started (Lifecycle Event)
Apr 11 19:53:21 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:53:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ada53cbc-a66c-42ef-817b-5aa5279b3f08 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.148s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:53:21 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:53:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-e2db88ba-cc2a-4857-b605-2ae2b577d253 req-3bf161e9-86a8-40ee-83d5-242b9c3802fc service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:53:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e2db88ba-cc2a-4857-b605-2ae2b577d253 req-3bf161e9-86a8-40ee-83d5-242b9c3802fc service nova] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:53:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e2db88ba-cc2a-4857-b605-2ae2b577d253 req-3bf161e9-86a8-40ee-83d5-242b9c3802fc service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:53:21 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e2db88ba-cc2a-4857-b605-2ae2b577d253 req-3bf161e9-86a8-40ee-83d5-242b9c3802fc service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:53:21 user nova-compute[82196]: DEBUG nova.compute.manager [req-e2db88ba-cc2a-4857-b605-2ae2b577d253 req-3bf161e9-86a8-40ee-83d5-242b9c3802fc service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] No waiting events found dispatching network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:53:21 user nova-compute[82196]: WARNING nova.compute.manager [req-e2db88ba-cc2a-4857-b605-2ae2b577d253 req-3bf161e9-86a8-40ee-83d5-242b9c3802fc service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received unexpected event network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 for instance with vm_state active and task_state None.
Apr 11 19:53:22 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:27 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:37 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:53:55 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:53:57 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:53:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:53:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:53:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:53:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:53:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:53:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:54:00 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:54:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:54:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:03 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:54:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:54:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:54:03 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:54:03 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:54:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:54:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:54:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:54:03 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:54:03 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:54:04 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:54:04 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:54:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8724MB free_disk=26.195865631103516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:54:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:54:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:54:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 52298792-b22d-4c8e-ba29-babc5653e2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:54:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:54:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:54:04 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:54:04 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:54:04 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:54:04 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:54:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:54:06 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:54:06 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:54:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:54:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:54:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:54:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:54:06 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:54:06 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:54:06 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating instance_info_cache with network_info: [{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:54:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:54:06 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:54:07 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:54:07 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:54:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:54:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:54:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:54:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:54:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:54:14 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:54:14 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:54:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:54:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:54:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:54:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:54:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:54:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:54:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:54:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:54:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:54:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:54:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:54:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:54:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:54:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:54:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:54:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:57 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:54:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:54:59 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:55:01 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:55:03 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:55:04 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-changed-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG nova.compute.manager [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Refreshing instance network info cache due to event network-changed-32c90c1c-3212-4427-a38d-f505443bf260. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] Acquiring lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] Acquired lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG nova.network.neutron [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Refreshing network info cache for port 32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:55:05 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:55:06 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:55:06 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8746MB free_disk=26.19528579711914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 52298792-b22d-4c8e-ba29-babc5653e2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.network.neutron [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updated VIF entry in instance network info cache for port 32c90c1c-3212-4427-a38d-f505443bf260. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.network.neutron [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating instance_info_cache with network_info: [{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-changed-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.compute.manager [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Refreshing instance network info cache due to event network-changed-32c90c1c-3212-4427-a38d-f505443bf260. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] Acquiring lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-2fc8912d-31c5-4175-97e5-ec583313d4af req-95855cb8-34eb-44dd-8e0f-49fb4f17af81 service nova] Releasing lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] Acquired lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.network.neutron [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Refreshing network info cache for port 32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:55:06 user nova-compute[82196]: INFO nova.compute.manager [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Detaching volume 54b75fb4-6f33-4acd-b9e2-4759c27ac582
Apr 11 19:55:06 user nova-compute[82196]: INFO nova.virt.block_device [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Attempting to driver detach volume 54b75fb4-6f33-4acd-b9e2-4759c27ac582 from mountpoint /dev/vdb
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Attempting to detach device vdb from instance 52298792-b22d-4c8e-ba29-babc5653e2cc from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:55:06 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:55:06 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:55:06 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:55:06 user nova-compute[82196]:   <serial>54b75fb4-6f33-4acd-b9e2-4759c27ac582</serial>
Apr 11 19:55:06 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 19:55:06 user nova-compute[82196]: </disk>
Apr 11 19:55:06 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:55:06 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Successfully detached device vdb from instance 52298792-b22d-4c8e-ba29-babc5653e2cc from the persistent domain config.
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 52298792-b22d-4c8e-ba29-babc5653e2cc from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 19:55:06 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 19:55:06 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:55:06 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:55:06 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:55:06 user nova-compute[82196]:   <serial>54b75fb4-6f33-4acd-b9e2-4759c27ac582</serial>
Apr 11 19:55:06 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 19:55:06 user nova-compute[82196]: </disk>
Apr 11 19:55:06 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG nova.network.neutron [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updated VIF entry in instance network info cache for port 32c90c1c-3212-4427-a38d-f505443bf260. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG nova.network.neutron [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating instance_info_cache with network_info: [{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-9fbe5c4b-0f2d-4a69-89b0-48023be41d60 req-56e123a8-5318-4d92-801a-6f8d331b45f4 service nova] Releasing lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681242907.214924, 52298792-b22d-4c8e-ba29-babc5653e2cc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 19:55:07 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Successfully detached device vdb from instance 52298792-b22d-4c8e-ba29-babc5653e2cc from the live domain config.
Apr 11 19:55:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPQvcHyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:55:07 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[522c6e6a-0dba-4500-86e3-a8550d0d78dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 19:55:07 user nova-compute[82196]: No targets found.
Apr 11 19:55:07 user nova-compute[82196]: iSNS:
Apr 11 19:55:07 user nova-compute[82196]: No targets found.
Apr 11 19:55:07 user nova-compute[82196]: STATIC:
Apr 11 19:55:07 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582
Apr 11 19:55:07 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 19:55:07 user nova-compute[82196]:                 Iface Name: default
Apr 11 19:55:07 user nova-compute[82196]: FIRMWARE:
Apr 11 19:55:07 user nova-compute[82196]: No targets found.
Apr 11 19:55:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 19:55:07 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 19:55:07 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb22808-c92d-4085-b5fb-27f32f00d34d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb6c1d7-f7cd-4de8-bf27-1bcd3c0c1415]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 (non-flash)
Apr 11 19:55:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 (non-flash)
Apr 11 19:55:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9281adb370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582'): ({'sdb'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Removing single pathed devices sdb {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aab2dd-4c6b-43ce-8ade-c53ad582bcd1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6514be85-4fe0-4aa5-ba83-b5a45f3f7168]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flushing IO for device /dev/sdb {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee2bfd7-a59f-46cf-866d-b849429f0bba]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aecdf29-915c-4c42-aec9-338bd105b053]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[94828c87-1861-4c69-b76e-6ffd607507ad]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bc3ef8-c5a3-4942-8113-ea4ea0698273]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260]
Apr 11 19:55:07 user nova-compute[82196]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582, portal: 172.16.0.220,3260] successful.
Apr 11 19:55:07 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b75fb4-6f33-4acd-b9e2-4759c27ac582 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e69dca0-c3d5-45a6-8ed4-dba22058a5d3]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] <== disconnect_volume: return (289ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:55:07 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 19:55:08 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:08 user nova-compute[82196]: DEBUG nova.objects.instance [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'flavor' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:55:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-ad37ae1d-11ed-405a-8f9e-e95599c803a4 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.647s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:55:08 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:55:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:55:08 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:55:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:55:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:55:08 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:55:08 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:55:09 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating instance_info_cache with network_info: [{"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:55:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-52298792-b22d-4c8e-ba29-babc5653e2cc" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:55:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:55:09 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:55:09 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:55:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:55:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:13 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:16 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:55:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:55:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:55:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:55:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:55:18 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:23 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:55:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:55:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:55:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:55:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:55:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:55:28 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:33 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:55:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:55:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:55:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:55:38 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:43 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:55:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:48 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:55:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:55:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:55:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:55:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:55:53 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:55:58 user nova-compute[82196]: INFO nova.compute.manager [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Terminating instance
Apr 11 19:55:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-28c5c1d1-3ff7-4fae-864c-432b90c9b261 req-a167af2e-373a-4f19-b1c8-61886ac7a716 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-vif-unplugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-28c5c1d1-3ff7-4fae-864c-432b90c9b261 req-a167af2e-373a-4f19-b1c8-61886ac7a716 service nova] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-28c5c1d1-3ff7-4fae-864c-432b90c9b261 req-a167af2e-373a-4f19-b1c8-61886ac7a716 service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-28c5c1d1-3ff7-4fae-864c-432b90c9b261 req-a167af2e-373a-4f19-b1c8-61886ac7a716 service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-28c5c1d1-3ff7-4fae-864c-432b90c9b261 req-a167af2e-373a-4f19-b1c8-61886ac7a716 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] No waiting events found dispatching network-vif-unplugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-28c5c1d1-3ff7-4fae-864c-432b90c9b261 req-a167af2e-373a-4f19-b1c8-61886ac7a716 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-vif-unplugged-32c90c1c-3212-4427-a38d-f505443bf260 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 19:55:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Instance destroyed successfully.
Apr 11 19:55:59 user nova-compute[82196]: DEBUG nova.objects.instance [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'resources' on Instance uuid 52298792-b22d-4c8e-ba29-babc5653e2cc {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1892471232',display_name='tempest-TestMinimumBasicScenario-server-1892471232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1892471232',id=46,image_ref='bf3454f9-a827-4dc1-a960-dc67109c289a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI18204baiBVey1ZMWNZgAXku8ITr+T9lmJFBe0OUSjsJjhwMsoF8Nia2sCNNHRfU+aQv/nMbkic9XzbeqSSkUeyn6yJaTTLyXjcGyr2kpsbZzhhonDPPZJaRnKWHYbpug==',key_name='tempest-TestMinimumBasicScenario-1152467569',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae5919e23c6a4c54b3a05a422c232c9f',ramdisk_id='',reservation_id='r-qqe0gs99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf3454f9-a827-4dc1-a960-dc67109c289a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1332908423',owner_user_name='tempest-TestMinimumBasicScenario-1332908423-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:53:21Z,user_data=None,user_id='2fbfa8948ce64dff92344749d2f0f0c7',uuid=52298792-b22d-4c8e-ba29-babc5653e2cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converting VIF {"id": "32c90c1c-3212-4427-a38d-f505443bf260", "address": "fa:16:3e:a5:10:b4", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c90c1c-32", "ovs_interfaceid": "32c90c1c-3212-4427-a38d-f505443bf260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG os_vif [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32c90c1c-32, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:55:59 user nova-compute[82196]: INFO os_vif [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:b4,bridge_name='br-int',has_traffic_filtering=True,id=32c90c1c-3212-4427-a38d-f505443bf260,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c90c1c-32')
Apr 11 19:55:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Deleting instance files /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc_del
Apr 11 19:55:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Deletion of /opt/stack/data/nova/instances/52298792-b22d-4c8e-ba29-babc5653e2cc_del complete
Apr 11 19:55:59 user nova-compute[82196]: INFO nova.compute.manager [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 19:55:59 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:55:59 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Took 0.43 seconds to deallocate network for instance.
Apr 11 19:55:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:55:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:55:59 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Deleted allocations for instance 52298792-b22d-4c8e-ba29-babc5653e2cc
Apr 11 19:55:59 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-e1b40888-b1d8-4d2e-8c91-35c11e099d52 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.586s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:56:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:56:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] Acquiring lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:56:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:56:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] Lock "52298792-b22d-4c8e-ba29-babc5653e2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:56:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] No waiting events found dispatching network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:56:00 user nova-compute[82196]: WARNING nova.compute.manager [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received unexpected event network-vif-plugged-32c90c1c-3212-4427-a38d-f505443bf260 for instance with vm_state deleted and task_state None.
Apr 11 19:56:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-90d10586-72ab-47ce-9204-9c986a4ffc2d req-0c1e3c89-17ed-49ca-bbaf-41f2c9266838 service nova] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Received event network-vif-deleted-32c90c1c-3212-4427-a38d-f505443bf260 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:56:01 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:56:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:56:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:04 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:56:05 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:56:05 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:56:05 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=26.214279174804688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:56:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:56:08 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:56:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:09 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:56:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:56:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:56:09 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Didn't find any instances for network info cache update. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 19:56:10 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:56:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:56:14 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681242959.0133197, 52298792-b22d-4c8e-ba29-babc5653e2cc => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:56:14 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] VM Stopped (Lifecycle Event)
Apr 11 19:56:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-1c4f311b-cbb4-4cf4-a5e8-f822b3191ec1 None None] [instance: 52298792-b22d-4c8e-ba29-babc5653e2cc] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:56:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:17 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:56:18 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:56:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:56:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:56:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:56:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:56:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:56:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:56:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:56:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Starting instance... {{(pid=82196) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82196) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 19:56:52 user nova-compute[82196]: INFO nova.compute.claims [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Claim successful on node user
Apr 11 19:56:52 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.180s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Start building networks asynchronously for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Allocating IP information in the background. {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] allocate_for_instance() {{(pid=82196) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 19:56:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 19:56:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Start building block device mappings for instance. {{(pid=82196) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG nova.policy [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fbfa8948ce64dff92344749d2f0f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5919e23c6a4c54b3a05a422c232c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82196) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Start spawning the instance on the hypervisor. {{(pid=82196) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Creating instance directory {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 19:56:52 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Creating image(s)
Apr 11 19:56:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "/opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "/opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "5a3b47411457206da5e5b1e756623b60032f9a1d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "5a3b47411457206da5e5b1e756623b60032f9a1d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:56:52 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d.part --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d.part --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG nova.virt.images [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 3da59beb-6b63-4e45-84d5-2bf5cf95f676 was qcow2, converting to raw {{(pid=82196) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG nova.privsep.utils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82196) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d.part /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d.converted {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Successfully created port: 90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d.part /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d.converted" returned: 0 in 0.192s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d.converted --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "5a3b47411457206da5e5b1e756623b60032f9a1d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.851s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "5a3b47411457206da5e5b1e756623b60032f9a1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "5a3b47411457206da5e5b1e756623b60032f9a1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d --force-share --output=json" returned: 0 in 0.140s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d,backing_fmt=raw /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk 1073741824 {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d,backing_fmt=raw /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk 1073741824" returned: 0 in 0.056s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "5a3b47411457206da5e5b1e756623b60032f9a1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Successfully updated port: 90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquired lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-changed-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG nova.compute.manager [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Refreshing instance network info cache due to event network-changed-90e5197f-3479-4c36-b5f9-b924ec023a53. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] Acquiring lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk. size=1073741824 {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 19:56:53 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Instance cache missing network info. {{(pid=82196) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.disk.api [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Cannot resize image /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk to a smaller size. {{(pid=82196) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'migration_context' on Instance uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Created local disks {{(pid=82196) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Ensure instance console log exists: /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/console.log {{(pid=82196) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.network.neutron [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Releasing lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Instance network_info: |[{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82196) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] Acquired lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Refreshing network info cache for port 90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Start _get_guest_xml network_info=[{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:56:50Z,direct_url=<?>,disk_format='qcow2',id=3da59beb-6b63-4e45-84d5-2bf5cf95f676,min_disk=0,min_ram=0,name='tempest-scenario-img--1891134224',owner='ae5919e23c6a4c54b3a05a422c232c9f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:56:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '3da59beb-6b63-4e45-84d5-2bf5cf95f676'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 19:56:54 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:56:54 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82196) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T19:18:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T19:56:50Z,direct_url=<?>,disk_format='qcow2',id=3da59beb-6b63-4e45-84d5-2bf5cf95f676,min_disk=0,min_ram=0,name='tempest-scenario-img--1891134224',owner='ae5919e23c6a4c54b3a05a422c232c9f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T19:56:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flavor limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Image limits 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flavor pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Image pref 0:0:0 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82196) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Got 1 possible topologies {{(pid=82196) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.hardware [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82196) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1999494387',display_name='tempest-TestMinimumBasicScenario-server-1999494387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1999494387',id=47,image_ref='3da59beb-6b63-4e45-84d5-2bf5cf95f676',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbBwZ4GED/tTw/bbYuLWx68FYgHHI5pQQLV1hYCUXSN7QLH6wpR4oKsETXcDq2hZfJmOMdySw0MmRduWvVkMii4pov1h0+m5OkFJ3s0PNpmsF4cBTTyXZMkUmqmxUrOJw==',key_name='tempest-TestMinimumBasicScenario-1895527350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae5919e23c6a4c54b3a05a422c232c9f',ramdisk_id='',reservation_id='r-cau7zl0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3da59beb-6b63-4e45-84d5-2bf5cf95f676',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1332908423',owner_user_name='tempest-TestMinimumBasicScenario-1332908423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:56:53Z,user_data=None,user_id='2fbfa8948ce64dff92344749d2f0f0c7',uuid=0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82196) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converting VIF {"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:1a:47,bridge_name='br-int',has_traffic_filtering=True,id=90e5197f-3479-4c36-b5f9-b924ec023a53,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e5197f-34') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.objects.instance [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] End _get_guest_xml xml=<domain type="kvm">
Apr 11 19:56:54 user nova-compute[82196]:   <uuid>0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4</uuid>
Apr 11 19:56:54 user nova-compute[82196]:   <name>instance-0000002f</name>
Apr 11 19:56:54 user nova-compute[82196]:   <memory>131072</memory>
Apr 11 19:56:54 user nova-compute[82196]:   <vcpu>1</vcpu>
Apr 11 19:56:54 user nova-compute[82196]:   <metadata>
Apr 11 19:56:54 user nova-compute[82196]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 19:56:54 user nova-compute[82196]:       <nova:package version="0.0.0"/>
Apr 11 19:56:54 user nova-compute[82196]:       <nova:name>tempest-TestMinimumBasicScenario-server-1999494387</nova:name>
Apr 11 19:56:54 user nova-compute[82196]:       <nova:creationTime>2023-04-11 19:56:54</nova:creationTime>
Apr 11 19:56:54 user nova-compute[82196]:       <nova:flavor name="m1.nano">
Apr 11 19:56:54 user nova-compute[82196]:         <nova:memory>128</nova:memory>
Apr 11 19:56:54 user nova-compute[82196]:         <nova:disk>1</nova:disk>
Apr 11 19:56:54 user nova-compute[82196]:         <nova:swap>0</nova:swap>
Apr 11 19:56:54 user nova-compute[82196]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 19:56:54 user nova-compute[82196]:         <nova:vcpus>1</nova:vcpus>
Apr 11 19:56:54 user nova-compute[82196]:       </nova:flavor>
Apr 11 19:56:54 user nova-compute[82196]:       <nova:owner>
Apr 11 19:56:54 user nova-compute[82196]:         <nova:user uuid="2fbfa8948ce64dff92344749d2f0f0c7">tempest-TestMinimumBasicScenario-1332908423-project-member</nova:user>
Apr 11 19:56:54 user nova-compute[82196]:         <nova:project uuid="ae5919e23c6a4c54b3a05a422c232c9f">tempest-TestMinimumBasicScenario-1332908423</nova:project>
Apr 11 19:56:54 user nova-compute[82196]:       </nova:owner>
Apr 11 19:56:54 user nova-compute[82196]:       <nova:root type="image" uuid="3da59beb-6b63-4e45-84d5-2bf5cf95f676"/>
Apr 11 19:56:54 user nova-compute[82196]:       <nova:ports>
Apr 11 19:56:54 user nova-compute[82196]:         <nova:port uuid="90e5197f-3479-4c36-b5f9-b924ec023a53">
Apr 11 19:56:54 user nova-compute[82196]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 19:56:54 user nova-compute[82196]:         </nova:port>
Apr 11 19:56:54 user nova-compute[82196]:       </nova:ports>
Apr 11 19:56:54 user nova-compute[82196]:     </nova:instance>
Apr 11 19:56:54 user nova-compute[82196]:   </metadata>
Apr 11 19:56:54 user nova-compute[82196]:   <sysinfo type="smbios">
Apr 11 19:56:54 user nova-compute[82196]:     <system>
Apr 11 19:56:54 user nova-compute[82196]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 19:56:54 user nova-compute[82196]:       <entry name="product">OpenStack Nova</entry>
Apr 11 19:56:54 user nova-compute[82196]:       <entry name="version">0.0.0</entry>
Apr 11 19:56:54 user nova-compute[82196]:       <entry name="serial">0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4</entry>
Apr 11 19:56:54 user nova-compute[82196]:       <entry name="uuid">0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4</entry>
Apr 11 19:56:54 user nova-compute[82196]:       <entry name="family">Virtual Machine</entry>
Apr 11 19:56:54 user nova-compute[82196]:     </system>
Apr 11 19:56:54 user nova-compute[82196]:   </sysinfo>
Apr 11 19:56:54 user nova-compute[82196]:   <os>
Apr 11 19:56:54 user nova-compute[82196]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 19:56:54 user nova-compute[82196]:     <boot dev="hd"/>
Apr 11 19:56:54 user nova-compute[82196]:     <smbios mode="sysinfo"/>
Apr 11 19:56:54 user nova-compute[82196]:   </os>
Apr 11 19:56:54 user nova-compute[82196]:   <features>
Apr 11 19:56:54 user nova-compute[82196]:     <acpi/>
Apr 11 19:56:54 user nova-compute[82196]:     <apic/>
Apr 11 19:56:54 user nova-compute[82196]:     <vmcoreinfo/>
Apr 11 19:56:54 user nova-compute[82196]:   </features>
Apr 11 19:56:54 user nova-compute[82196]:   <clock offset="utc">
Apr 11 19:56:54 user nova-compute[82196]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 19:56:54 user nova-compute[82196]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 19:56:54 user nova-compute[82196]:     <timer name="hpet" present="no"/>
Apr 11 19:56:54 user nova-compute[82196]:   </clock>
Apr 11 19:56:54 user nova-compute[82196]:   <cpu mode="custom" match="exact">
Apr 11 19:56:54 user nova-compute[82196]:     <model>Nehalem</model>
Apr 11 19:56:54 user nova-compute[82196]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 19:56:54 user nova-compute[82196]:   </cpu>
Apr 11 19:56:54 user nova-compute[82196]:   <devices>
Apr 11 19:56:54 user nova-compute[82196]:     <disk type="file" device="disk">
Apr 11 19:56:54 user nova-compute[82196]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 19:56:54 user nova-compute[82196]:       <source file="/opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk"/>
Apr 11 19:56:54 user nova-compute[82196]:       <target dev="vda" bus="virtio"/>
Apr 11 19:56:54 user nova-compute[82196]:     </disk>
Apr 11 19:56:54 user nova-compute[82196]:     <interface type="ethernet">
Apr 11 19:56:54 user nova-compute[82196]:       <mac address="fa:16:3e:36:1a:47"/>
Apr 11 19:56:54 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:56:54 user nova-compute[82196]:       <mtu size="1442"/>
Apr 11 19:56:54 user nova-compute[82196]:       <target dev="tap90e5197f-34"/>
Apr 11 19:56:54 user nova-compute[82196]:     </interface>
Apr 11 19:56:54 user nova-compute[82196]:     <serial type="pty">
Apr 11 19:56:54 user nova-compute[82196]:       <log file="/opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/console.log" append="off"/>
Apr 11 19:56:54 user nova-compute[82196]:     </serial>
Apr 11 19:56:54 user nova-compute[82196]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 19:56:54 user nova-compute[82196]:     <video>
Apr 11 19:56:54 user nova-compute[82196]:       <model type="virtio"/>
Apr 11 19:56:54 user nova-compute[82196]:     </video>
Apr 11 19:56:54 user nova-compute[82196]:     <rng model="virtio">
Apr 11 19:56:54 user nova-compute[82196]:       <backend model="random">/dev/urandom</backend>
Apr 11 19:56:54 user nova-compute[82196]:     </rng>
Apr 11 19:56:54 user nova-compute[82196]:     <controller type="usb" index="0" model="none"/>
Apr 11 19:56:54 user nova-compute[82196]:     <memballoon model="virtio">
Apr 11 19:56:54 user nova-compute[82196]:       <stats period="10"/>
Apr 11 19:56:54 user nova-compute[82196]:     </memballoon>
Apr 11 19:56:54 user nova-compute[82196]:   </devices>
Apr 11 19:56:54 user nova-compute[82196]: </domain>
Apr 11 19:56:54 user nova-compute[82196]:  {{(pid=82196) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1999494387',display_name='tempest-TestMinimumBasicScenario-server-1999494387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1999494387',id=47,image_ref='3da59beb-6b63-4e45-84d5-2bf5cf95f676',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbBwZ4GED/tTw/bbYuLWx68FYgHHI5pQQLV1hYCUXSN7QLH6wpR4oKsETXcDq2hZfJmOMdySw0MmRduWvVkMii4pov1h0+m5OkFJ3s0PNpmsF4cBTTyXZMkUmqmxUrOJw==',key_name='tempest-TestMinimumBasicScenario-1895527350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae5919e23c6a4c54b3a05a422c232c9f',ramdisk_id='',reservation_id='r-cau7zl0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3da59beb-6b63-4e45-84d5-2bf5cf95f676',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1332908423',owner_user_name='tempest-TestMinimumBasicScenario-1332908423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T19:56:53Z,user_data=None,user_id='2fbfa8948ce64dff92344749d2f0f0c7',uuid=0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converting VIF {"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:1a:47,bridge_name='br-int',has_traffic_filtering=True,id=90e5197f-3479-4c36-b5f9-b924ec023a53,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e5197f-34') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG os_vif [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:1a:47,bridge_name='br-int',has_traffic_filtering=True,id=90e5197f-3479-4c36-b5f9-b924ec023a53,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e5197f-34') {{(pid=82196) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90e5197f-34, may_exist=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90e5197f-34, col_values=(('external_ids', {'iface-id': '90e5197f-3479-4c36-b5f9-b924ec023a53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:1a:47', 'vm-uuid': '0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4'}),)) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:54 user nova-compute[82196]: INFO os_vif [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:1a:47,bridge_name='br-int',has_traffic_filtering=True,id=90e5197f-3479-4c36-b5f9-b924ec023a53,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e5197f-34')
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] No VIF found with MAC fa:16:3e:36:1a:47, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updated VIF entry in instance network info cache for port 90e5197f-3479-4c36-b5f9-b924ec023a53. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG nova.network.neutron [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:56:54 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7caf5753-6adc-49b8-92ed-5d60ab3bee62 req-e3d9b11f-a016-484a-ba0c-7f0a8995495e service nova] Releasing lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:56:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-61504779-6d8e-4aa7-9f25-05a2c1abcb3e req-55896521-d3a4-4cf7-9847-cde7ca5eee3b service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:56:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-61504779-6d8e-4aa7-9f25-05a2c1abcb3e req-55896521-d3a4-4cf7-9847-cde7ca5eee3b service nova] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:56:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-61504779-6d8e-4aa7-9f25-05a2c1abcb3e req-55896521-d3a4-4cf7-9847-cde7ca5eee3b service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:56:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-61504779-6d8e-4aa7-9f25-05a2c1abcb3e req-55896521-d3a4-4cf7-9847-cde7ca5eee3b service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:56:56 user nova-compute[82196]: DEBUG nova.compute.manager [req-61504779-6d8e-4aa7-9f25-05a2c1abcb3e req-55896521-d3a4-4cf7-9847-cde7ca5eee3b service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] No waiting events found dispatching network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:56:56 user nova-compute[82196]: WARNING nova.compute.manager [req-61504779-6d8e-4aa7-9f25-05a2c1abcb3e req-55896521-d3a4-4cf7-9847-cde7ca5eee3b service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received unexpected event network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 for instance with vm_state building and task_state spawning.
Apr 11 19:56:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:56 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681243017.942092, 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:56:57 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] VM Resumed (Lifecycle Event)
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Instance event wait completed in 0 seconds for  {{(pid=82196) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Guest created on hypervisor {{(pid=82196) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 19:56:57 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Instance spawned successfully.
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Found default for hw_cdrom_bus of ide {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Found default for hw_disk_bus of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Found default for hw_input_bus of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Found default for hw_pointer_model of None {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Found default for hw_video_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Found default for hw_vif_model of virtio {{(pid=82196) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 19:56:57 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:56:57 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681243017.9459436, 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:56:58 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] VM Started (Lifecycle Event)
Apr 11 19:56:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:56:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:56:58 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 19:56:58 user nova-compute[82196]: INFO nova.compute.manager [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Took 5.46 seconds to spawn the instance on the hypervisor.
Apr 11 19:56:58 user nova-compute[82196]: DEBUG nova.compute.manager [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:56:58 user nova-compute[82196]: INFO nova.compute.manager [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Took 5.93 seconds to build instance.
Apr 11 19:56:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-8cfa433f-eb53-4da3-9886-589e2ff7fa2b tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.019s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:56:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-b5f3f01a-e2de-4667-8654-4257a508aefb req-7a7a258c-a166-4665-8984-f79b8ac7060e service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:56:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b5f3f01a-e2de-4667-8654-4257a508aefb req-7a7a258c-a166-4665-8984-f79b8ac7060e service nova] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:56:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b5f3f01a-e2de-4667-8654-4257a508aefb req-7a7a258c-a166-4665-8984-f79b8ac7060e service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:56:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-b5f3f01a-e2de-4667-8654-4257a508aefb req-7a7a258c-a166-4665-8984-f79b8ac7060e service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:56:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-b5f3f01a-e2de-4667-8654-4257a508aefb req-7a7a258c-a166-4665-8984-f79b8ac7060e service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] No waiting events found dispatching network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:56:58 user nova-compute[82196]: WARNING nova.compute.manager [req-b5f3f01a-e2de-4667-8654-4257a508aefb req-7a7a258c-a166-4665-8984-f79b8ac7060e service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received unexpected event network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 for instance with vm_state active and task_state None.
Apr 11 19:56:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:00 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:57:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:01 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:57:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:57:04 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:57:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:05 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:57:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:57:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:57:05 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:57:05 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:57:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:57:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:57:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:57:05 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:57:06 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:57:06 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:57:06 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=26.196456909179688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:57:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:57:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:57:06 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:57:06 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:57:06 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:57:06 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:57:06 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:57:06 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:57:06 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:57:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:10 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:57:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:57:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:57:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:57:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:57:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:57:10 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:57:10 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:57:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:57:10 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:57:10 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:57:12 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:57:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:57:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:20 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:57:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Verify base images {{(pid=82196) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Image id 3da59beb-6b63-4e45-84d5-2bf5cf95f676 yields fingerprint 5a3b47411457206da5e5b1e756623b60032f9a1d {{(pid=82196) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 11 19:57:25 user nova-compute[82196]: INFO nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] image 3da59beb-6b63-4e45-84d5-2bf5cf95f676 at (/opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d): checking
Apr 11 19:57:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] image 3da59beb-6b63-4e45-84d5-2bf5cf95f676 at (/opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d): image is in use {{(pid=82196) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=82196) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 is a valid instance name {{(pid=82196) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 has a disk file {{(pid=82196) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 is backed by 5a3b47411457206da5e5b1e756623b60032f9a1d {{(pid=82196) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 11 19:57:25 user nova-compute[82196]: WARNING nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee
Apr 11 19:57:25 user nova-compute[82196]: WARNING nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd
Apr 11 19:57:25 user nova-compute[82196]: WARNING nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3
Apr 11 19:57:25 user nova-compute[82196]: WARNING nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10
Apr 11 19:57:25 user nova-compute[82196]: WARNING nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf
Apr 11 19:57:25 user nova-compute[82196]: WARNING nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753
Apr 11 19:57:25 user nova-compute[82196]: WARNING nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b
Apr 11 19:57:25 user nova-compute[82196]: WARNING nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1
Apr 11 19:57:25 user nova-compute[82196]: WARNING nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9
Apr 11 19:57:25 user nova-compute[82196]: INFO nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Active base files: /opt/stack/data/nova/instances/_base/5a3b47411457206da5e5b1e756623b60032f9a1d
Apr 11 19:57:25 user nova-compute[82196]: INFO nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Removable base files: /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3 /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10 /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753 /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1 /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9
Apr 11 19:57:25 user nova-compute[82196]: INFO nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/03f5748f4fa280a4eb90eabd56922b871c5ae6ee
Apr 11 19:57:25 user nova-compute[82196]: INFO nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f2fe166eb4d8938082cd18d3fbb77b236278e4fd
Apr 11 19:57:25 user nova-compute[82196]: INFO nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/89eef8ff90c4f69f0301643d4e449f4e1d6ab7c3
Apr 11 19:57:25 user nova-compute[82196]: INFO nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c0a08172f78eaca2cd1f1f9f51c0b951abf8ec10
Apr 11 19:57:25 user nova-compute[82196]: INFO nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3ea5b866ae2134daa5cf5c9e63fb6905a2143adf
Apr 11 19:57:25 user nova-compute[82196]: INFO nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dbee1c7cedbe49547520d8cccf5fab967c16b753
Apr 11 19:57:25 user nova-compute[82196]: INFO nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cedaaac894b2c27ba5e83cd337150871a7ec191b
Apr 11 19:57:25 user nova-compute[82196]: INFO nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/976fa510ed0176378abde9a45fafd25889319de1
Apr 11 19:57:25 user nova-compute[82196]: INFO nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/83e681eaac3001e5271a806d2430b36aff39d7b9
Apr 11 19:57:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Verification complete {{(pid=82196) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Verify swap images {{(pid=82196) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 11 19:57:25 user nova-compute[82196]: DEBUG nova.virt.libvirt.imagecache [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Verify ephemeral images {{(pid=82196) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 11 19:57:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:57:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:57:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:57:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:57:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:57:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:57:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:57:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:58:06 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:07 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:58:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:58:07 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:58:07 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:58:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:07 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:08 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:58:08 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:58:08 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=26.1761474609375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing inventories for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Updating ProviderTree inventory for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Updating inventory in ProviderTree for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing aggregate associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, aggregates: None {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Refreshing trait associations for resource provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82196) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:58:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:58:09 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:58:11 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:11 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:58:11 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:58:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:58:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:58:11 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:58:11 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:58:12 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:58:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:58:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:58:12 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:12 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:12 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:58:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:58:17 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:58:20 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 19:58:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] There are 0 instances to clean {{(pid=82196) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 19:58:20 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:20 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82196) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 19:58:21 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:58:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:58:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:58:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:58:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG nova.objects.instance [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'flavor' on Instance uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:58:44 user nova-compute[82196]: INFO nova.compute.manager [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Attaching volume a85f292d-3b39-4c88-9675-3953235146c9 to /dev/vdb
Apr 11 19:58:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG os_brick.utils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a3498b-4214-40e7-aea4-ca89dab1ff66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:204b123f3ec9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[d188d1c2-cc4c-453b-8c0a-4731ee7c56af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb89969-7f94-4186-b3ec-d8421dd3482c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef34d67f-4d59-46af-a0c7-8b40fd4bbd95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Running cmd (subprocess): nvme version {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] 'nvme version' failed. Not Retrying. {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.nvmeof [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] nvme not present on system {{(pid=82196) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 19:58:44 user nova-compute[82196]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 19:58:44 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd4cafd-096c-4ea5-b18f-2d47e90f8d2b]: (4, '') {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82196) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.lightos [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] LIGHTOS: no hostnqn found. {{(pid=82196) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG os_brick.utils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:204b123f3ec9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:58:44 user nova-compute[82196]: DEBUG nova.virt.block_device [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating existing volume attachment record: 70012d5e-66cc-41e1-a915-d868a8c54472 {{(pid=82196) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 19:58:46 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:58:46 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Triggering sync for uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 19:58:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Calling os-brick to attach iSCSI Volume {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZtRlJcSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 19:58:48 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:58:48 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 19:58:48 user nova-compute[82196]: INFO os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d924d79-191c-4b0c-8d29-fe86e3b27058]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 19:58:48 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b970b3-af98-42fc-94a9-733ae3db361d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9] added\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9] added
Apr 11 19:58:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28160e4-707c-459f-9116-efd362c18c40]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2de4b0-ed88-4ab5-817c-41e508ac437d]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZtRlJcSE {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZtRlJcSE" returned: 0 in 0.016s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62e72c1-347a-4b50-b35d-2bd7cdc89318]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZtRlJcSE'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe85f2b7-893c-4377-bd36-6de47dafa934]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b66d1a-54e0-427d-8e1c-49244e651514]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 19:58:48 user nova-compute[82196]:  {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 19:58:48 user nova-compute[82196]:  {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:58:48 user nova-compute[82196]: WARNING os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 19:58:48 user nova-compute[82196]: 
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --login {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cd5779-0ea9-4030-8d9f-2f2e5153f8d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9, portal: 172.16.0.220,3260]
Apr 11 19:58:48 user nova-compute[82196]: Login to [iface: default, target: iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9, portal: 172.16.0.220,3260] successful.
Apr 11 19:58:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2a08b0-3e78-4efe-b601-5c3260b0fcc6]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea46f7b7-551f-42b7-ad91-c92cd9fce8c9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 (non-flash)
Apr 11 19:58:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 (non-flash)
Apr 11 19:58:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Connected to 172.16.0.220:3260 {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=82196) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82196) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 19:58:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:58:49 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:58:49 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b265574-39e1-4ebe-badc-24e0213eef5f]: (4, ('- - 0', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 19:58:49 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82196) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 19:58:49 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZtRlJcSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82196) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 19:58:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:58:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 19:58:50 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23361356364633263', 'path': '/dev/sdb'} {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 19:58:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361356364633263', 'path': '/dev/sdb'} {{(pid=82196) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 19:58:50 user nova-compute[82196]: DEBUG nova.objects.instance [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'flavor' on Instance uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:58:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 19:58:50 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 19:58:50 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 19:58:50 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 19:58:50 user nova-compute[82196]:   <serial>a85f292d-3b39-4c88-9675-3953235146c9</serial>
Apr 11 19:58:50 user nova-compute[82196]: </disk>
Apr 11 19:58:50 user nova-compute[82196]:  {{(pid=82196) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 19:58:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] No BDM found with device name vda, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:58:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82196) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 19:58:50 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] No VIF found with MAC fa:16:3e:36:1a:47, not building metadata {{(pid=82196) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 19:58:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-639af96f-876e-467c-a31e-aca4b01c6709 tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:58:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.051s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:58:50 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:58:51 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-changed-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:58:52 user nova-compute[82196]: DEBUG nova.compute.manager [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Refreshing instance network info cache due to event network-changed-90e5197f-3479-4c36-b5f9-b924ec023a53. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:58:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] Acquiring lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:58:52 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] Acquired lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:58:52 user nova-compute[82196]: DEBUG nova.network.neutron [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Refreshing network info cache for port 90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:58:53 user nova-compute[82196]: DEBUG nova.network.neutron [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updated VIF entry in instance network info cache for port 90e5197f-3479-4c36-b5f9-b924ec023a53. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:58:53 user nova-compute[82196]: DEBUG nova.network.neutron [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:58:53 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-4ca7c475-67c3-468e-9a29-0d0d0fa1e620 req-282c8bed-224a-44d0-811e-e78cbb907287 service nova] Releasing lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:58:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-changed-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG nova.compute.manager [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Refreshing instance network info cache due to event network-changed-90e5197f-3479-4c36-b5f9-b924ec023a53. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] Acquiring lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] Acquired lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG nova.network.neutron [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Refreshing network info cache for port 90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:58:55 user nova-compute[82196]: INFO nova.compute.manager [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Rebooting instance
Apr 11 19:58:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG nova.network.neutron [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updated VIF entry in instance network info cache for port 90e5197f-3479-4c36-b5f9-b924ec023a53. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG nova.network.neutron [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-aa141e0b-27f4-4107-bd15-ada71a70ea81 req-f8b16f7c-3e88-4539-a3cf-fa560cf5b184 service nova] Releasing lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquired lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:58:55 user nova-compute[82196]: DEBUG nova.network.neutron [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Building network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 19:58:56 user nova-compute[82196]: DEBUG nova.network.neutron [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:58:56 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Releasing lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:58:56 user nova-compute[82196]: DEBUG nova.compute.manager [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:58:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:58 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:58:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-7067bdc6-cd32-4e78-855e-873a68ff4983 req-5b48bb2a-63b5-4726-9826-ca1e2dfdd007 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-vif-unplugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:58:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7067bdc6-cd32-4e78-855e-873a68ff4983 req-5b48bb2a-63b5-4726-9826-ca1e2dfdd007 service nova] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:58:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7067bdc6-cd32-4e78-855e-873a68ff4983 req-5b48bb2a-63b5-4726-9826-ca1e2dfdd007 service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:58:58 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7067bdc6-cd32-4e78-855e-873a68ff4983 req-5b48bb2a-63b5-4726-9826-ca1e2dfdd007 service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:58:58 user nova-compute[82196]: DEBUG nova.compute.manager [req-7067bdc6-cd32-4e78-855e-873a68ff4983 req-5b48bb2a-63b5-4726-9826-ca1e2dfdd007 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] No waiting events found dispatching network-vif-unplugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:58:58 user nova-compute[82196]: WARNING nova.compute.manager [req-7067bdc6-cd32-4e78-855e-873a68ff4983 req-5b48bb2a-63b5-4726-9826-ca1e2dfdd007 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received unexpected event network-vif-unplugged-90e5197f-3479-4c36-b5f9-b924ec023a53 for instance with vm_state active and task_state reboot_started.
Apr 11 19:58:59 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Instance shutdown successfully.
Apr 11 19:58:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-3cfd73b2-5bcb-4547-9c16-3b135fddb6cf req-b7472bc7-212b-4e45-b804-52cd8d9f61f6 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:59:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cfd73b2-5bcb-4547-9c16-3b135fddb6cf req-b7472bc7-212b-4e45-b804-52cd8d9f61f6 service nova] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:59:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cfd73b2-5bcb-4547-9c16-3b135fddb6cf req-b7472bc7-212b-4e45-b804-52cd8d9f61f6 service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:59:00 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-3cfd73b2-5bcb-4547-9c16-3b135fddb6cf req-b7472bc7-212b-4e45-b804-52cd8d9f61f6 service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:59:00 user nova-compute[82196]: DEBUG nova.compute.manager [req-3cfd73b2-5bcb-4547-9c16-3b135fddb6cf req-b7472bc7-212b-4e45-b804-52cd8d9f61f6 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] No waiting events found dispatching network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:59:00 user nova-compute[82196]: WARNING nova.compute.manager [req-3cfd73b2-5bcb-4547-9c16-3b135fddb6cf req-b7472bc7-212b-4e45-b804-52cd8d9f61f6 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received unexpected event network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 for instance with vm_state active and task_state reboot_started.
Apr 11 19:59:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:01 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG nova.virt.libvirt.host [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Removed pending event for 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 due to event {{(pid=82196) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681243142.5606663, 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => Resumed> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:59:02 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] VM Resumed (Lifecycle Event)
Apr 11 19:59:02 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Instance running successfully.
Apr 11 19:59:02 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Instance soft rebooted successfully.
Apr 11 19:59:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:59:02 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 11 19:59:02 user nova-compute[82196]: DEBUG nova.virt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Emitting event <LifecycleEvent: 1681243142.5631502, 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => Started> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 19:59:02 user nova-compute[82196]: INFO nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] VM Started (Lifecycle Event)
Apr 11 19:59:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-60509050-b496-4a3b-92bd-3410e03b0cdd tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.208s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG nova.compute.manager [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82196) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] No waiting events found dispatching network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:59:02 user nova-compute[82196]: WARNING nova.compute.manager [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received unexpected event network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 for instance with vm_state active and task_state None.
Apr 11 19:59:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:59:02 user nova-compute[82196]: DEBUG nova.compute.manager [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] No waiting events found dispatching network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 19:59:02 user nova-compute[82196]: WARNING nova.compute.manager [req-e26cf019-4452-4cb3-97a0-e8906e854fce req-826ffb16-a36d-4f9a-92d4-01714db6bef5 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received unexpected event network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 for instance with vm_state active and task_state None.
Apr 11 19:59:04 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:59:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:08 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:59:08 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:59:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:59:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:59:08 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:59:08 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 19:59:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:59:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:59:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 19:59:08 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 19:59:08 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 19:59:09 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:59:09 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 19:59:09 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8721MB free_disk=26.174293518066406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 19:59:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 19:59:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 19:59:09 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 19:59:09 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 19:59:09 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 19:59:09 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 19:59:09 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 19:59:09 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 19:59:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 19:59:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:59:13 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 19:59:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:21 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 19:59:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:59:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:59:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 19:59:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:59:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 19:59:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 19:59:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 19:59:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:04 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:00:04 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:00:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:00:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:00:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:00:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:00:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:05 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:00:09 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:00:09 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:00:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:00:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:00:09 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:00:09 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:00:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:00:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:00:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:00:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:09 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:00:09 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82196) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:00:10 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:00:10 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:00:10 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8749MB free_disk=26.173511505126953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:00:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:00:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:00:10 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:00:10 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:00:10 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:00:10 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:00:10 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:00:10 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:00:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:00:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:00:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:00:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:00:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:00:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:00:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:20 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:00:21 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:00:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:00:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:00:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:00:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:00:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:44 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:46 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-changed-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:00:46 user nova-compute[82196]: DEBUG nova.compute.manager [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Refreshing instance network info cache due to event network-changed-90e5197f-3479-4c36-b5f9-b924ec023a53. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:00:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] Acquiring lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:00:46 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] Acquired lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:00:46 user nova-compute[82196]: DEBUG nova.network.neutron [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Refreshing network info cache for port 90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:00:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updated VIF entry in instance network info cache for port 90e5197f-3479-4c36-b5f9-b924ec023a53. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:00:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:00:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-7fb00eeb-2783-422e-8bf6-3ed70e65c57e req-cb47cdcd-7b15-4c85-89f9-aacfa621050f service nova] Releasing lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:00:47 user nova-compute[82196]: DEBUG nova.compute.manager [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-changed-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:00:47 user nova-compute[82196]: DEBUG nova.compute.manager [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Refreshing instance network info cache due to event network-changed-90e5197f-3479-4c36-b5f9-b924ec023a53. {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:00:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] Acquiring lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:00:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] Acquired lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:00:47 user nova-compute[82196]: DEBUG nova.network.neutron [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Refreshing network info cache for port 90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:00:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:00:47 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:00:47 user nova-compute[82196]: INFO nova.compute.manager [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Detaching volume a85f292d-3b39-4c88-9675-3953235146c9
Apr 11 20:00:47 user nova-compute[82196]: INFO nova.virt.block_device [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Attempting to driver detach volume a85f292d-3b39-4c88-9675-3953235146c9 from mountpoint /dev/vdb
Apr 11 20:00:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Attempting to detach device vdb from instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 from the persistent domain config. {{(pid=82196) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:00:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:00:47 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:00:47 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 20:00:47 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:00:47 user nova-compute[82196]:   <serial>a85f292d-3b39-4c88-9675-3953235146c9</serial>
Apr 11 20:00:47 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:00:47 user nova-compute[82196]: </disk>
Apr 11 20:00:47 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:00:47 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Successfully detached device vdb from instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 from the persistent domain config.
Apr 11 20:00:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 from the live domain config. {{(pid=82196) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:00:47 user nova-compute[82196]: DEBUG nova.virt.libvirt.guest [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:00:47 user nova-compute[82196]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:00:47 user nova-compute[82196]:   <source dev="/dev/sdb"/>
Apr 11 20:00:47 user nova-compute[82196]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:00:47 user nova-compute[82196]:   <serial>a85f292d-3b39-4c88-9675-3953235146c9</serial>
Apr 11 20:00:47 user nova-compute[82196]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:00:47 user nova-compute[82196]: </disk>
Apr 11 20:00:47 user nova-compute[82196]:  {{(pid=82196) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG nova.network.neutron [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updated VIF entry in instance network info cache for port 90e5197f-3479-4c36-b5f9-b924ec023a53. {{(pid=82196) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG nova.network.neutron [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-56722b6d-e36d-49fc-96ba-c7b6ba4e7dd8 req-c2af5f62-0d3d-4fb1-a639-13ac4a93a249 service nova] Releasing lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-36d71c23-194e-42b6-afad-2575e51ee5bb None None] Received event <DeviceRemovedEvent: 1681243248.2793827, 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82196) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.driver [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:00:48 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Successfully detached device vdb from instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 from the live domain config.
Apr 11 20:00:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] calling os-brick to detach iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f927411f430>, {'target_iqn': 'iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZtRlJcSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:00:48 user nova-compute[82196]: WARNING os_brick.initiator.connectors.base [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b08ae08-de4c-4fa2-a5f8-a3395a6de991]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:00:48 user nova-compute[82196]: No targets found.
Apr 11 20:00:48 user nova-compute[82196]: iSNS:
Apr 11 20:00:48 user nova-compute[82196]: No targets found.
Apr 11 20:00:48 user nova-compute[82196]: STATIC:
Apr 11 20:00:48 user nova-compute[82196]: Target: iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9
Apr 11 20:00:48 user nova-compute[82196]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:00:48 user nova-compute[82196]:                 Iface Name: default
Apr 11 20:00:48 user nova-compute[82196]: FIRMWARE:
Apr 11 20:00:48 user nova-compute[82196]: No targets found.
Apr 11 20:00:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:00:48 user nova-compute[82196]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:00:48 user nova-compute[82196]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82196) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9', 0)] {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[99318fdb-00da-4d89-9161-d9d7d0088ac6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9966973-a512-481f-9290-e708cc76adc3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 (non-flash)\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 (non-flash)
Apr 11 20:00:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 (non-flash)
Apr 11 20:00:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f92641c0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9'): ({'sdb'}, set())}) {{(pid=82196) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Removing single pathed devices sdb {{(pid=82196) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[661209b9-dfef-4190-ba54-3d434969a41d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd85b8d1-2a35-48fd-a944-7fae46b06b21]: (4, ('ok\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Flushing IO for device /dev/sdb {{(pid=82196) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[70036377-abfd-4077-b16f-b3446747e235]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82196) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bb1326-ef23-4afa-ad92-b4c83fa9f29e]: (4, ('1', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.linuxscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] SCSI volumes sdb have been removed. {{(pid=82196) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9')] {{(pid=82196) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f667b9d-c17b-4e1e-a62c-85658dd337bc]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --logout {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[2821ac98-85bd-4ade-98a5-cc596c4a0554]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9, portal: 172.16.0.220,3260]
Apr 11 20:00:48 user nova-compute[82196]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9, portal: 172.16.0.220,3260] successful.
Apr 11 20:00:48 user nova-compute[82196]:  stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op delete {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f292d-3b39-4c88-9675-3953235146c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=91954) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78e31bb-6ae3-4e68-86a3-9d2a05a6d8b8]: (4, ('', '')) {{(pid=91954) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82196) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.base [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] <== disconnect_volume: return (285ms) None {{(pid=82196) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:00:48 user nova-compute[82196]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Disconnected iSCSI Volume {{(pid=82196) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:00:49 user nova-compute[82196]: DEBUG nova.objects.instance [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'flavor' on Instance uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:00:49 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-5a62c9d9-c4f3-42e4-a02e-0ffada1d643e tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.668s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:00:49 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:54 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:00:59 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:04 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:05 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:01:06 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:01:07 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:01:09 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:01:10 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:01:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:01:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:01:10 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:01:10 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:01:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:01:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:01:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:01:10 user nova-compute[82196]: DEBUG oslo_concurrency.processutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82196) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:01:11 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:01:11 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:01:11 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8744MB free_disk=26.17272186279297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:01:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:01:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:01:11 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82196) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:01:11 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:01:11 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:01:11 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:01:11 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:01:11 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:01:11 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:01:12 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:01:14 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:01:14 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:01:14 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:01:15 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:01:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:01:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 20:01:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:01:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquired lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:01:15 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Forcefully refreshing network info cache for instance {{(pid=82196) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:01:15 user nova-compute[82196]: DEBUG nova.objects.instance [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lazy-loading 'info_cache' on Instance uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:01:15 user nova-compute[82196]: DEBUG nova.network.neutron [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [{"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:01:15 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Releasing lock "refresh_cache-0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" {{(pid=82196) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:01:15 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updated the network info_cache for instance {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:01:15 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:01:19 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:01:22 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:01:24 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:01:29 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:34 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:01:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:01:39 user nova-compute[82196]: INFO nova.compute.manager [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Terminating instance
Apr 11 20:01:39 user nova-compute[82196]: DEBUG nova.compute.manager [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Start destroying the instance on the hypervisor. {{(pid=82196) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG nova.compute.manager [req-62bd4c29-5849-432c-96c8-9c3db1e94aed req-102fa9b7-4fd7-4dbc-8cef-6ec371119c91 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-vif-unplugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-62bd4c29-5849-432c-96c8-9c3db1e94aed req-102fa9b7-4fd7-4dbc-8cef-6ec371119c91 service nova] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-62bd4c29-5849-432c-96c8-9c3db1e94aed req-102fa9b7-4fd7-4dbc-8cef-6ec371119c91 service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-62bd4c29-5849-432c-96c8-9c3db1e94aed req-102fa9b7-4fd7-4dbc-8cef-6ec371119c91 service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG nova.compute.manager [req-62bd4c29-5849-432c-96c8-9c3db1e94aed req-102fa9b7-4fd7-4dbc-8cef-6ec371119c91 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] No waiting events found dispatching network-vif-unplugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG nova.compute.manager [req-62bd4c29-5849-432c-96c8-9c3db1e94aed req-102fa9b7-4fd7-4dbc-8cef-6ec371119c91 service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-vif-unplugged-90e5197f-3479-4c36-b5f9-b924ec023a53 for instance with task_state deleting. {{(pid=82196) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:01:39 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:40 user nova-compute[82196]: INFO nova.virt.libvirt.driver [-] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Instance destroyed successfully.
Apr 11 20:01:40 user nova-compute[82196]: DEBUG nova.objects.instance [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lazy-loading 'resources' on Instance uuid 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 {{(pid=82196) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG nova.virt.libvirt.vif [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T19:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1999494387',display_name='tempest-TestMinimumBasicScenario-server-1999494387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1999494387',id=47,image_ref='3da59beb-6b63-4e45-84d5-2bf5cf95f676',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbBwZ4GED/tTw/bbYuLWx68FYgHHI5pQQLV1hYCUXSN7QLH6wpR4oKsETXcDq2hZfJmOMdySw0MmRduWvVkMii4pov1h0+m5OkFJ3s0PNpmsF4cBTTyXZMkUmqmxUrOJw==',key_name='tempest-TestMinimumBasicScenario-1895527350',keypairs=<?>,launch_index=0,launched_at=2023-04-11T19:56:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae5919e23c6a4c54b3a05a422c232c9f',ramdisk_id='',reservation_id='r-cau7zl0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3da59beb-6b63-4e45-84d5-2bf5cf95f676',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1332908423',owner_user_name='tempest-TestMinimumBasicScenario-1332908423-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T19:59:03Z,user_data=None,user_id='2fbfa8948ce64dff92344749d2f0f0c7',uuid=0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converting VIF {"id": "90e5197f-3479-4c36-b5f9-b924ec023a53", "address": "fa:16:3e:36:1a:47", "network": {"id": "9d90c2b0-40f8-4911-a518-b03cdd738924", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1858088385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5919e23c6a4c54b3a05a422c232c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e5197f-34", "ovs_interfaceid": "90e5197f-3479-4c36-b5f9-b924ec023a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG nova.network.os_vif_util [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:1a:47,bridge_name='br-int',has_traffic_filtering=True,id=90e5197f-3479-4c36-b5f9-b924ec023a53,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e5197f-34') {{(pid=82196) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG os_vif [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:1a:47,bridge_name='br-int',has_traffic_filtering=True,id=90e5197f-3479-4c36-b5f9-b924ec023a53,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e5197f-34') {{(pid=82196) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90e5197f-34, bridge=br-int, if_exists=True) {{(pid=82196) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:01:40 user nova-compute[82196]: INFO os_vif [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:1a:47,bridge_name='br-int',has_traffic_filtering=True,id=90e5197f-3479-4c36-b5f9-b924ec023a53,network=Network(9d90c2b0-40f8-4911-a518-b03cdd738924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e5197f-34')
Apr 11 20:01:40 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Deleting instance files /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4_del
Apr 11 20:01:40 user nova-compute[82196]: INFO nova.virt.libvirt.driver [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Deletion of /opt/stack/data/nova/instances/0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4_del complete
Apr 11 20:01:40 user nova-compute[82196]: INFO nova.compute.manager [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 20:01:40 user nova-compute[82196]: DEBUG oslo.service.loopingcall [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82196) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG nova.compute.manager [-] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Deallocating network for instance {{(pid=82196) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] deallocate_for_instance() {{(pid=82196) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG nova.network.neutron [-] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Updating instance_info_cache with network_info: [] {{(pid=82196) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:01:40 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Took 0.46 seconds to deallocate network for instance.
Apr 11 20:01:40 user nova-compute[82196]: DEBUG nova.compute.manager [req-7f3f557e-53d4-4350-bfd8-3571ae77cac1 req-35b2c95d-3a30-4bd3-942d-8ca5ef06649d service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-vif-deleted-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:01:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:01:40 user nova-compute[82196]: INFO nova.scheduler.client.report [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Deleted allocations for instance 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4
Apr 11 20:01:40 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-480f3bec-d089-4014-b9a4-9f7359f8d74c tempest-TestMinimumBasicScenario-1332908423 tempest-TestMinimumBasicScenario-1332908423-project-member] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.607s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:01:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-07d037d4-a0d1-4144-98c3-ef7c54f30084 req-392afb72-df53-4522-bb02-dbc63048558a service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received event network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:01:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-07d037d4-a0d1-4144-98c3-ef7c54f30084 req-392afb72-df53-4522-bb02-dbc63048558a service nova] Acquiring lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:01:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-07d037d4-a0d1-4144-98c3-ef7c54f30084 req-392afb72-df53-4522-bb02-dbc63048558a service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:01:41 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [req-07d037d4-a0d1-4144-98c3-ef7c54f30084 req-392afb72-df53-4522-bb02-dbc63048558a service nova] Lock "0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:01:41 user nova-compute[82196]: DEBUG nova.compute.manager [req-07d037d4-a0d1-4144-98c3-ef7c54f30084 req-392afb72-df53-4522-bb02-dbc63048558a service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] No waiting events found dispatching network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 {{(pid=82196) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:01:41 user nova-compute[82196]: WARNING nova.compute.manager [req-07d037d4-a0d1-4144-98c3-ef7c54f30084 req-392afb72-df53-4522-bb02-dbc63048558a service nova] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Received unexpected event network-vif-plugged-90e5197f-3479-4c36-b5f9-b924ec023a53 for instance with vm_state deleted and task_state None.
Apr 11 20:01:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:55 user nova-compute[82196]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681243300.147404, 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4 => Stopped> {{(pid=82196) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:01:55 user nova-compute[82196]: INFO nova.compute.manager [-] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] VM Stopped (Lifecycle Event)
Apr 11 20:01:55 user nova-compute[82196]: DEBUG nova.compute.manager [None req-0fdbf933-8e9f-4beb-924f-7c6c554cfaab None None] [instance: 0d8e59e7-3ea5-4fea-bc23-e258eb7a61b4] Checking state {{(pid=82196) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:01:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:01:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:01:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:01:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:01:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:01:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:02:00 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:02:05 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:02:05 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:02:07 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:02:09 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:02:10 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:02:11 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Auditing locally available compute resources for user (node: user) {{(pid=82196) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:02:12 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:02:12 user nova-compute[82196]: WARNING nova.virt.libvirt.driver [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:02:12 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Hypervisor/Node resource view: name=user free_ram=8845MB free_disk=26.191932678222656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82196) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82196) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG nova.compute.provider_tree [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed in ProviderTree for provider: 05f5e47c-70b3-42ff-8927-09fa1d35aec2 {{(pid=82196) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG nova.scheduler.client.report [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Inventory has not changed for provider 05f5e47c-70b3-42ff-8927-09fa1d35aec2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82196) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG nova.compute.resource_tracker [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Compute_service record updated for user:user {{(pid=82196) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:02:12 user nova-compute[82196]: DEBUG oslo_concurrency.lockutils [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=82196) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:02:15 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:02:16 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:02:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Starting heal instance info cache {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:02:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Rebuilding the list of instances to heal {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 20:02:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Didn't find any instances for network info cache update. {{(pid=82196) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 20:02:16 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:02:16 user nova-compute[82196]: DEBUG nova.compute.manager [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82196) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:02:17 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:02:20 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:02:22 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:02:22 user nova-compute[82196]: DEBUG oslo_service.periodic_task [None req-365970da-9178-4540-8fec-6398fcc0b3a3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82196) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:02:25 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:02:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:02:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:02:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82196) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:02:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:02:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82196) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:02:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:02:30 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:02:32 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:02:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:02:35 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:02:40 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:02:45 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:02:50 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:02:55 user nova-compute[82196]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82196) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}